[ 592.327151] env[68328]: INFO neutron.common.config [-] Logging enabled! [ 592.327421] env[68328]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 26.1.0.dev38 [ 592.327618] env[68328]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=68328) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 592.327946] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 592.328077] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 592.328937] env[68328]: WARNING oslo_policy.policy [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 592.329197] env[68328]: WARNING oslo_policy.policy [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 592.330713] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] VMware NSXv3 Agent initialized successfully. [ 592.331092] env[68328]: DEBUG oslo_concurrency.lockutils [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] Acquiring lock "singleton_lock" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.331244] env[68328]: DEBUG oslo_concurrency.lockutils [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] Acquired lock "singleton_lock" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.331459] env[68328]: DEBUG oslo_concurrency.lockutils [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] Releasing lock "singleton_lock" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.331824] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] Full set of CONF: {{(pid=68328) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/eventlet/service.py:357}} [ 592.332072] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] ******************************************************************************** {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 592.332208] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] Configuration options gathered from: {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 592.332465] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 592.332642] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 592.332756] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] ================================================================================ {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 592.332931] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] agent_down_time = 75 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.333106] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] allow_automatic_dhcp_failover = True {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.333264] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] allow_bulk = True {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.333418] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] api_extensions_path = {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.333566] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] api_paste_config = api-paste.ini {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.333713] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] auth_strategy = keystone {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.333828] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] backdoor_port = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.333939] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] backdoor_socket = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.334106] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] backlog = 4096 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.334262] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] base_mac = fa:16:3e:00:00:00 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.334432] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] bind_host = 0.0.0.0 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.334578] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] bind_port = 9696 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.334723] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] client_socket_timeout = 900 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.334871] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] config_dir = [] {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.334987] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.335170] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] config_source = [] {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.335323] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] control_exchange = neutron {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.335472] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] core_plugin = ml2 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.335619] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] debug = True {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.335765] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] default_availability_zones = [] {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.335981] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.336170] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] dhcp_agent_notification = True {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.336324] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] dhcp_agents_per_network = 1 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.336468] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] dhcp_lease_duration = 86400 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.336621] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] dhcp_load_type = networks {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.336769] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] dns_domain = openstacklocal {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.336916] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.337069] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] enable_default_route_bfd = False {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.337213] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] enable_default_route_ecmp = False {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.337351] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] enable_dvr = True {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.337489] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] enable_new_agents = True {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.337627] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.337784] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] enable_signals = True {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.337927] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] enable_traditional_dhcp = True {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.338074] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] external_dns_driver = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.338213] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] filter_validation = True {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.338359] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] global_physnet_mtu = 8950 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.338499] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] graceful_shutdown_timeout = 60 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.338686] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] host = cpu-1 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.338832] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] host_dvr_for_dhcp = True {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.338971] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] http_retries = 3 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.339153] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] instance_format = [instance: %(uuid)s] {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.339305] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.339450] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] ipam_driver = internal {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.339589] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] ipv6_pd_enabled = False {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.339727] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] l3_ha = False {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.339871] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.340026] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] l3_ha_network_physical_name = {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.340197] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] l3_ha_network_type = {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.340349] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] log_color = False {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.340496] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] log_config_append = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.340643] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.340781] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] log_dir = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.340919] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] log_file = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.341054] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] log_options = True {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.341214] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] log_rotate_interval = 1 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.341364] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] log_rotate_interval_type = days {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.341511] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] log_rotation_type = none {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.341633] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.341812] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.342020] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.342173] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.342287] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.342433] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] max_dns_nameservers = 5 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.342574] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] max_header_line = 16384 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.342715] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] max_l3_agents_per_router = 3 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.342854] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] max_logfile_count = 30 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.342992] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] max_logfile_size_mb = 200 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.343145] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] max_subnet_host_routes = 20 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.343293] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] my_ip = 10.180.1.21 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.343435] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] my_ipv6 = ::1 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.343574] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] network_auto_schedule = True {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.343710] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] network_link_prefix = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.343856] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.344006] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] notify_nova_on_port_data_changes = True {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.344189] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] notify_nova_on_port_status_changes = True {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.344342] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] pagination_max_limit = -1 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.344485] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] publish_errors = False {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.344622] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] rate_limit_burst = 0 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.344771] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] rate_limit_except_level = CRITICAL {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.344911] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] rate_limit_interval = 0 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.345075] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] retry_until_window = 30 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.345228] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] router_distributed = False {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.345369] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] rpc_resources_processing_step = 20 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.345508] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] rpc_response_max_timeout = 600 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.345648] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] rpc_response_timeout = 60 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.345786] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] send_events_interval = 2 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.345944] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] service_plugins = ['router'] {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.346115] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] setproctitle = on {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.346262] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] shell_completion = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.346408] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] state_path = /opt/stack/data/neutron {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.346553] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] syslog_log_facility = LOG_USER {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.346697] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] tcp_keepidle = 600 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.346842] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] transport_url = **** {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.346984] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] use_journal = False {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.347135] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] use_json = False {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.347274] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] use_ssl = False {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.347412] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] use_stderr = False {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.347555] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] use_syslog = False {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.347706] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] vlan_qinq = False {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.347867] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] vlan_transparent = False {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.348016] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] watch_log_file = False {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.348191] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] wsgi_default_pool_size = 100 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.348336] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] wsgi_keep_alive = True {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.348486] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.348627] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] wsgi_server_debug = False {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 592.348785] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_concurrency.disable_process_locking = False {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.348936] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.349099] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.349244] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.349390] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.349533] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.349675] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.349859] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] profiler.connection_string = messaging:// {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.349981] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] profiler.enabled = False {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.350173] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] profiler.es_doc_type = notification {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.350323] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] profiler.es_scroll_size = 10000 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.350472] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] profiler.es_scroll_time = 2m {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.350616] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] profiler.filter_error_trace = False {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.350765] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] profiler.hmac_keys = **** {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.350907] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] profiler.sentinel_service_name = mymaster {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.351067] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] profiler.socket_timeout = 0.1 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.351212] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] profiler.trace_requests = False {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.351350] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] profiler.trace_sqlalchemy = False {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.351507] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] profiler_jaeger.process_tags = {} {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.351649] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] profiler_jaeger.service_name_prefix = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.351796] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] profiler_otlp.service_name_prefix = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.351953] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_policy.enforce_new_defaults = True {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.352237] env[68328]: WARNING oslo_config.cfg [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 592.352395] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_policy.enforce_scope = True {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.352544] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_policy.policy_default_rule = default {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.352702] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.352852] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.353013] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.353155] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.353294] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.353432] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.353573] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.353723] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_policy.remote_timeout = 60.0 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.353879] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.354040] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] agent.extensions = [] {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.354190] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.354339] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] service_providers.service_provider = [] {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.354488] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] QUOTAS.default_quota = -1 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.354636] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.354777] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] QUOTAS.quota_floatingip = 50 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.354919] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] QUOTAS.quota_network = 100 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.355069] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] QUOTAS.quota_port = 500 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.355210] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.355349] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] QUOTAS.quota_router = 10 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.355487] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] QUOTAS.quota_security_group = 10 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.355626] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.355766] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] QUOTAS.quota_subnet = 100 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.355909] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] QUOTAS.track_quota_usage = True {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.356073] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.356239] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] privsep.group = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.356383] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] privsep.helper_command = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.356531] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.356677] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] privsep.thread_pool_size = 8 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.356820] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] privsep.user = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.356972] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.357125] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] privsep_dhcp_release.group = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.357264] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] privsep_dhcp_release.helper_command = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.357410] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.357553] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.357745] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] privsep_dhcp_release.user = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.357869] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.358020] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] privsep_ovs_vsctl.group = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.358161] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] privsep_ovs_vsctl.helper_command = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.358307] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.358450] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.358585] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] privsep_ovs_vsctl.user = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.358752] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] privsep_namespace.capabilities = [21] {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.358901] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] privsep_namespace.group = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.359052] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] privsep_namespace.helper_command = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.359199] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.359344] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] privsep_namespace.thread_pool_size = 8 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.359487] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] privsep_namespace.user = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.359635] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] privsep_conntrack.capabilities = [12] {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.359773] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] privsep_conntrack.group = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.359911] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] privsep_conntrack.helper_command = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.360072] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.360220] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.360361] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] privsep_conntrack.user = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.360511] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] privsep_link.capabilities = [12, 21] {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.360650] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] privsep_link.group = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.360791] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] privsep_link.helper_command = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.360937] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.361092] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] privsep_link.thread_pool_size = 8 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.361232] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] privsep_link.user = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.361393] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.361546] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.361696] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] AGENT.continue_on_failed_promotions = False {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.361840] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] AGENT.dscp = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.361986] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] AGENT.dscp_inherit = False {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.362149] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] AGENT.force_mp_to_policy = True {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.362293] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] AGENT.locking_coordinator_url = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.362439] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] AGENT.log_agent_heartbeats = False {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.362584] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] AGENT.logging_expire = 1 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.362735] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.362884] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.363045] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] AGENT.polling_interval = 240 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.363194] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.363348] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.363499] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] AGENT.report_interval = 30.0 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.363651] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.363801] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.363952] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.364109] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] AGENT.sync_skew = 60 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.364252] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] AGENT.synchronization_queue_size = 20 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.364400] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] AGENT.use_helper_for_ns_read = True {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.364551] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] SECURITYGROUP.enable_ipset = True {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.364702] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] SECURITYGROUP.enable_security_group = True {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.364866] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.365022] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.365167] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] experimental.ipv6_pd_enabled = False {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.365334] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] ml2.extension_drivers = ['port_security'] {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.365478] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] ml2.external_network_type = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.365635] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.365788] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] ml2.overlay_ip_version = 4 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.365940] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] ml2.path_mtu = 8950 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.366102] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] ml2.physical_network_mtus = {} {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.366259] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] ml2.tenant_network_types = ['vlan'] {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.366408] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.366561] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] ml2.type_drivers = ['vlan'] {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.366717] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] AGENT_CLI.neutron_port_id = [] {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.366866] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.367020] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.367182] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.367339] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.367489] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.367639] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.367814] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.367970] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.368194] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.368355] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] NSXV3.nsxv3_login_password = **** {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.368511] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] NSXV3.nsxv3_login_port = 443 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.368667] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] NSXV3.nsxv3_login_user = admin {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.368838] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.368996] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.369156] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.369299] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.369451] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.369605] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.369756] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.369906] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.370063] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.370214] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.370366] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.370511] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.370659] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.370863] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.371031] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] vsphere.vsphere_login_password = VMware1! {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.371183] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.371329] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.371480] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] nova.auth_section = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.371633] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] nova.auth_type = password {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.371781] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.371922] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] nova.certfile = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.372077] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] nova.collect_timing = False {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.372231] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] nova.endpoint_type = public {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.372374] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] nova.insecure = False {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.372516] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] nova.keyfile = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.372666] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] nova.region_name = RegionOne {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.372840] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] nova.split_loggers = False {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.373011] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] nova.timeout = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.373169] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] placement.auth_section = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.373323] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] placement.auth_type = password {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.373472] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.373614] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] placement.certfile = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.373758] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] placement.collect_timing = False {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.373911] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] placement.endpoint_type = public {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.374067] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] placement.insecure = False {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.374211] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] placement.keyfile = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.374350] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] placement.region_name = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.374492] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] placement.split_loggers = False {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.374630] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] placement.timeout = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.374779] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] ironic.auth_section = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.374993] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] ironic.auth_type = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.375082] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] ironic.cafile = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.375213] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] ironic.certfile = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.375356] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] ironic.collect_timing = False {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.375495] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] ironic.connect_retries = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.375634] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] ironic.connect_retry_delay = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.375777] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] ironic.enable_notifications = False {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.375916] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] ironic.endpoint_override = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.376067] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] ironic.insecure = False {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.376212] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] ironic.interface = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.376345] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] ironic.keyfile = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.376482] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] ironic.max_version = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.376619] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] ironic.min_version = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.376755] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] ironic.region_name = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.376895] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] ironic.retriable_status_codes = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.377039] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] ironic.service_name = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.377181] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] ironic.service_type = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.377325] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] ironic.split_loggers = False {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.377462] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] ironic.status_code_retries = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.377600] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] ironic.status_code_retry_delay = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.377770] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] ironic.timeout = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.377911] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] ironic.valid_interfaces = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.378061] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] ironic.version = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.378212] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] cli_script.dry_run = False {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.378366] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.378508] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.378652] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.378820] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.378967] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.379120] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.379262] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.379406] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.379549] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.379700] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.379842] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.380035] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.380182] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.380300] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.380701] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.380907] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.381073] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.381224] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.381379] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.381526] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.381671] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.381821] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.381969] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.382134] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.382281] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.382424] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.382566] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.382709] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.382850] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.382994] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.383152] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_messaging_rabbit.ssl = False {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.383302] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.383448] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.383593] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.383739] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.383885] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_messaging_rabbit.ssl_version = {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.384038] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.384197] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_messaging_notifications.driver = [] {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.384342] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_messaging_notifications.retry = -1 {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.384499] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.384640] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] oslo_messaging_notifications.transport_url = **** {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 592.384753] env[68328]: DEBUG oslo_service.backend.eventlet.service [None req-fd931f84-7330-4758-b29e-cfc526a87937 None None] ******************************************************************************** {{(pid=68328) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 592.385750] env[68328]: DEBUG neutron.agent.securitygroups_rpc [None req-038e1d26-3718-4954-be87-7b533345599d None None] Init firewall settings (driver=nsxv3) {{(pid=68328) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 592.387078] env[68328]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-038e1d26-3718-4954-be87-7b533345599d None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=68328) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 592.387328] env[68328]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-038e1d26-3718-4954-be87-7b533345599d None None] RPC agent_id: nsxm-l-01a.corp.local [ 592.389618] env[68328]: DEBUG dogpile.cache.region [None req-038e1d26-3718-4954-be87-7b533345599d None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 592.389741] env[68328]: DEBUG dogpile.lock [None req-038e1d26-3718-4954-be87-7b533345599d None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 592.389841] env[68328]: DEBUG dogpile.lock [None req-038e1d26-3718-4954-be87-7b533345599d None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 592.389936] env[68328]: DEBUG dogpile.lock [None req-038e1d26-3718-4954-be87-7b533345599d None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 592.390067] env[68328]: DEBUG dogpile.cache.region [None req-038e1d26-3718-4954-be87-7b533345599d None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 592.390171] env[68328]: DEBUG dogpile.lock [None req-038e1d26-3718-4954-be87-7b533345599d None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 592.390298] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-038e1d26-3718-4954-be87-7b533345599d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 592.425201] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-038e1d26-3718-4954-be87-7b533345599d None None] Session token - acquiring [ 592.426685] env[68328]: DEBUG networking_nsxv3.common.locking [None req-038e1d26-3718-4954-be87-7b533345599d None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.426847] env[68328]: DEBUG oslo_concurrency.lockutils [None req-038e1d26-3718-4954-be87-7b533345599d None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.426953] env[68328]: DEBUG oslo_concurrency.lockutils [None req-038e1d26-3718-4954-be87-7b533345599d None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.427379] env[68328]: DEBUG oslo_concurrency.lockutils [None req-038e1d26-3718-4954-be87-7b533345599d None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.437418] env[68328]: DEBUG oslo_concurrency.lockutils [None req-038e1d26-3718-4954-be87-7b533345599d None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.710664] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-038e1d26-3718-4954-be87-7b533345599d None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 592.731114] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-038e1d26-3718-4954-be87-7b533345599d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 592.731249] env[68328]: DEBUG dogpile.cache.region [None req-038e1d26-3718-4954-be87-7b533345599d None None] Cache value generated in 0.341 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 592.731359] env[68328]: DEBUG dogpile.lock [None req-038e1d26-3718-4954-be87-7b533345599d None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 592.731480] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-038e1d26-3718-4954-be87-7b533345599d None None] Activating Policy API Provider. [ 592.731676] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-038e1d26-3718-4954-be87-7b533345599d None None] Looking for the default Infrastructure Rules. [ 592.791709] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-038e1d26-3718-4954-be87-7b533345599d None None] Looking for the Default Layer3 Logged Drop Section. [ 592.804594] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-038e1d26-3718-4954-be87-7b533345599d None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 592.805035] env[68328]: DEBUG networking_nsxv3.common.locking [None req-038e1d26-3718-4954-be87-7b533345599d None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.805211] env[68328]: DEBUG oslo_concurrency.lockutils [None req-038e1d26-3718-4954-be87-7b533345599d None None] Acquiring lock "all" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.805316] env[68328]: DEBUG oslo_concurrency.lockutils [None req-038e1d26-3718-4954-be87-7b533345599d None None] Acquired lock "all" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.805591] env[68328]: DEBUG oslo_concurrency.lockutils [None req-038e1d26-3718-4954-be87-7b533345599d None None] Acquired external semaphore "all" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.805914] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-038e1d26-3718-4954-be87-7b533345599d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.321441] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-038e1d26-3718-4954-be87-7b533345599d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.823546] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-038e1d26-3718-4954-be87-7b533345599d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.326270] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-038e1d26-3718-4954-be87-7b533345599d None None] Inventory metadata is going to be refreshed. [ 594.326471] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-038e1d26-3718-4954-be87-7b533345599d None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 595.013287] env[68328]: DEBUG networking_nsxv3.common.locking [None req-038e1d26-3718-4954-be87-7b533345599d None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.013691] env[68328]: DEBUG oslo_concurrency.lockutils [None req-038e1d26-3718-4954-be87-7b533345599d None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.013691] env[68328]: DEBUG oslo_concurrency.lockutils [None req-038e1d26-3718-4954-be87-7b533345599d None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.013854] env[68328]: DEBUG oslo_concurrency.lockutils [None req-038e1d26-3718-4954-be87-7b533345599d None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.025447] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-038e1d26-3718-4954-be87-7b533345599d None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 595.132320] env[68328]: DEBUG oslo_concurrency.lockutils [None req-038e1d26-3718-4954-be87-7b533345599d None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.133340] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-038e1d26-3718-4954-be87-7b533345599d None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 595.150830] env[68328]: DEBUG networking_nsxv3.common.locking [None req-038e1d26-3718-4954-be87-7b533345599d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.151049] env[68328]: DEBUG oslo_concurrency.lockutils [None req-038e1d26-3718-4954-be87-7b533345599d None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.151265] env[68328]: DEBUG oslo_concurrency.lockutils [None req-038e1d26-3718-4954-be87-7b533345599d None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.151437] env[68328]: DEBUG oslo_concurrency.lockutils [None req-038e1d26-3718-4954-be87-7b533345599d None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.151566] env[68328]: DEBUG oslo_concurrency.lockutils [None req-038e1d26-3718-4954-be87-7b533345599d None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.151717] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-038e1d26-3718-4954-be87-7b533345599d None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 595.151835] env[68328]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-038e1d26-3718-4954-be87-7b533345599d None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=68328) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 595.151943] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-038e1d26-3718-4954-be87-7b533345599d None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 595.169911] env[68328]: DEBUG networking_nsxv3.common.locking [None req-038e1d26-3718-4954-be87-7b533345599d None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.170200] env[68328]: DEBUG oslo_concurrency.lockutils [None req-038e1d26-3718-4954-be87-7b533345599d None None] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.170296] env[68328]: DEBUG oslo_concurrency.lockutils [None req-038e1d26-3718-4954-be87-7b533345599d None None] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.170536] env[68328]: DEBUG oslo_concurrency.lockutils [None req-038e1d26-3718-4954-be87-7b533345599d None None] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.170712] env[68328]: DEBUG oslo_concurrency.lockutils [None req-038e1d26-3718-4954-be87-7b533345599d None None] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.170861] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-038e1d26-3718-4954-be87-7b533345599d None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 595.193588] env[68328]: DEBUG networking_nsxv3.common.locking [None req-038e1d26-3718-4954-be87-7b533345599d None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.193822] env[68328]: DEBUG oslo_concurrency.lockutils [None req-038e1d26-3718-4954-be87-7b533345599d None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.193864] env[68328]: DEBUG oslo_concurrency.lockutils [None req-038e1d26-3718-4954-be87-7b533345599d None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.194268] env[68328]: DEBUG oslo_concurrency.lockutils [None req-038e1d26-3718-4954-be87-7b533345599d None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.194423] env[68328]: DEBUG oslo_concurrency.lockutils [None req-038e1d26-3718-4954-be87-7b533345599d None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.194573] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-038e1d26-3718-4954-be87-7b533345599d None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 595.214307] env[68328]: DEBUG networking_nsxv3.common.locking [None req-038e1d26-3718-4954-be87-7b533345599d None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.214522] env[68328]: DEBUG oslo_concurrency.lockutils [None req-038e1d26-3718-4954-be87-7b533345599d None None] Acquiring lock "Address Group" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.214567] env[68328]: DEBUG oslo_concurrency.lockutils [None req-038e1d26-3718-4954-be87-7b533345599d None None] Acquired lock "Address Group" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.214854] env[68328]: DEBUG oslo_concurrency.lockutils [None req-038e1d26-3718-4954-be87-7b533345599d None None] Acquired external semaphore "Address Group" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.214995] env[68328]: DEBUG oslo_concurrency.lockutils [None req-038e1d26-3718-4954-be87-7b533345599d None None] Releasing lock "Address Group" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.215162] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-038e1d26-3718-4954-be87-7b533345599d None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 595.215270] env[68328]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-038e1d26-3718-4954-be87-7b533345599d None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=68328) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 595.215377] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-038e1d26-3718-4954-be87-7b533345599d None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 595.232783] env[68328]: DEBUG networking_nsxv3.common.locking [None req-038e1d26-3718-4954-be87-7b533345599d None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.232957] env[68328]: DEBUG oslo_concurrency.lockutils [None req-038e1d26-3718-4954-be87-7b533345599d None None] Acquiring lock "Segment QoS" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.233100] env[68328]: DEBUG oslo_concurrency.lockutils [None req-038e1d26-3718-4954-be87-7b533345599d None None] Acquired lock "Segment QoS" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.233336] env[68328]: DEBUG oslo_concurrency.lockutils [None req-038e1d26-3718-4954-be87-7b533345599d None None] Acquired external semaphore "Segment QoS" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.233461] env[68328]: DEBUG oslo_concurrency.lockutils [None req-038e1d26-3718-4954-be87-7b533345599d None None] Releasing lock "Segment QoS" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.233600] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-038e1d26-3718-4954-be87-7b533345599d None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 595.233707] env[68328]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-038e1d26-3718-4954-be87-7b533345599d None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=68328) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 595.233813] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-038e1d26-3718-4954-be87-7b533345599d None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 595.256664] env[68328]: DEBUG networking_nsxv3.common.locking [None req-038e1d26-3718-4954-be87-7b533345599d None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.256911] env[68328]: DEBUG oslo_concurrency.lockutils [None req-038e1d26-3718-4954-be87-7b533345599d None None] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.256911] env[68328]: DEBUG oslo_concurrency.lockutils [None req-038e1d26-3718-4954-be87-7b533345599d None None] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.257195] env[68328]: DEBUG oslo_concurrency.lockutils [None req-038e1d26-3718-4954-be87-7b533345599d None None] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.257335] env[68328]: DEBUG oslo_concurrency.lockutils [None req-038e1d26-3718-4954-be87-7b533345599d None None] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.257481] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-038e1d26-3718-4954-be87-7b533345599d None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 595.257587] env[68328]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-038e1d26-3718-4954-be87-7b533345599d None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=68328) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 595.257689] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-038e1d26-3718-4954-be87-7b533345599d None None] Inventory metadata have been refreshed. [ 595.257851] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-038e1d26-3718-4954-be87-7b533345599d None None] Dryrun:True. Metadata refresh completed. [ 595.257973] env[68328]: DEBUG oslo_concurrency.lockutils [None req-038e1d26-3718-4954-be87-7b533345599d None None] Releasing lock "all" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.259657] env[68328]: INFO neutron.agent.agent_extensions_manager [None req-038e1d26-3718-4954-be87-7b533345599d None None] Loaded agent extensions: [] [ 595.260375] env[68328]: DEBUG neutron_lib.callbacks.manager [None req-038e1d26-3718-4954-be87-7b533345599d None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=68328) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 595.307301] env[68328]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-038e1d26-3718-4954-be87-7b533345599d None None] NSXv3 Agent Agent RPC Daemon Started! [ 595.307450] env[68328]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-038e1d26-3718-4954-be87-7b533345599d None None] NSXv3 Agent Agent loop - iteration:0 started [ 595.307514] env[68328]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-038e1d26-3718-4954-be87-7b533345599d None None] NSXv3 Agent Agent out of sync with plugin! [ 600.261064] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 600.261064] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 601.264029] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.264476] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.264476] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.264710] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.264894] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.767244] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.269350] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.771714] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 602.771886] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 603.580734] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.581199] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.581199] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.581199] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.592792] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 603.593549] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.594201] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 603.610087] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.610273] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.610340] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.610515] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.610597] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.610698] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 603.610768] env[68328]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=68328) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 603.610838] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 603.630909] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.631120] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.631120] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.631267] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.631390] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.631488] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 603.648353] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.648512] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.648576] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.648684] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.648776] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.648870] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 603.673285] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.673486] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.673486] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.673652] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.673750] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.673878] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 603.673955] env[68328]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=68328) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 603.674035] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 603.691736] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.691977] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.692097] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.692282] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.692368] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.692470] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 603.692541] env[68328]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=68328) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 603.692612] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 603.713262] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.713443] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.713443] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.713597] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.713690] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.713798] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 603.713886] env[68328]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=68328) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 603.713955] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 603.714026] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 603.714102] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 603.714155] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 603.714219] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 603.714494] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 603.714560] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 603.714628] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 603.736646] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.736646] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.736646] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.736646] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.736646] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.736646] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 603.755205] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.755358] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.755358] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.755549] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.755608] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.767571] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.262689] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 605.263089] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 609.022777] env[68328]: INFO networking_nsxv3.common.synchronization [None req-c26af382-410d-4a9d-95aa-ad8a161102f4 demo admin] Enqueued Resource ID: 87b92422-a730-4a12-8c04-1df2650c52ab with Priority: HIGHEST for action security_group_rules [ 609.023069] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87b92422-a730-4a12-8c04-1df2650c52ab with Priority: HIGHEST for action security_group_rules [ 609.023363] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-87b92422-a730-4a12-8c04-1df2650c52ab taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.023486] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-87b92422-a730-4a12-8c04-1df2650c52ab" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.023556] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-87b92422-a730-4a12-8c04-1df2650c52ab" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.023811] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-87b92422-a730-4a12-8c04-1df2650c52ab" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.023899] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('87b92422-a730-4a12-8c04-1df2650c52ab',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.544672] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.544842] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.544883] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.545084] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.545177] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.545272] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 87b92422-a730-4a12-8c04-1df2650c52ab already deleted. [ 609.545354] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-87b92422-a730-4a12-8c04-1df2650c52ab" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.024287] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 614.024631] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 619.025264] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 619.025662] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 624.025986] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 624.026342] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 629.028658] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 629.028658] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 632.498092] env[68328]: INFO networking_nsxv3.common.synchronization [None req-929a0e1c-06d3-4ebc-b3ba-d768ba3aee5d None None] Enqueued Resource ID: 01cc560d-1dd7-4b42-9c38-363d12c5620a with Priority: HIGHEST for action port [ 632.498619] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01cc560d-1dd7-4b42-9c38-363d12c5620a with Priority: HIGHEST for action port [ 632.498911] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-01cc560d-1dd7-4b42-9c38-363d12c5620a taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.499532] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-01cc560d-1dd7-4b42-9c38-363d12c5620a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.499614] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-01cc560d-1dd7-4b42-9c38-363d12c5620a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.499888] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-01cc560d-1dd7-4b42-9c38-363d12c5620a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.499958] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01cc560d-1dd7-4b42-9c38-363d12c5620a',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.002413] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 01cc560d-1dd7-4b42-9c38-363d12c5620a [ 633.002879] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.003132] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.003212] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.003427] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.003516] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.003610] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:01cc560d-1dd7-4b42-9c38-363d12c5620a already deleted. [ 633.003689] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-01cc560d-1dd7-4b42-9c38-363d12c5620a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.314850] env[68328]: INFO networking_nsxv3.common.synchronization [None req-33224fd1-f278-4a44-ac3a-d94909e741fc None None] Enqueued Resource ID: f3cee614-ef84-4272-907d-71b07783fe81 with Priority: HIGHEST for action port [ 634.315182] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3cee614-ef84-4272-907d-71b07783fe81 with Priority: HIGHEST for action port [ 634.315586] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3cee614-ef84-4272-907d-71b07783fe81 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.316184] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3cee614-ef84-4272-907d-71b07783fe81" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.316333] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3cee614-ef84-4272-907d-71b07783fe81" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.316629] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3cee614-ef84-4272-907d-71b07783fe81" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.316754] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3cee614-ef84-4272-907d-71b07783fe81',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.780767] env[68328]: INFO networking_nsxv3.common.synchronization [None req-c2a023fd-6063-4200-8327-2acc8d752b1f None None] Enqueued Resource ID: 7c65a375-3f88-4860-998f-760c5fc836a5 with Priority: HIGHEST for action port [ 634.781017] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c65a375-3f88-4860-998f-760c5fc836a5 with Priority: HIGHEST for action port [ 634.781596] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c65a375-3f88-4860-998f-760c5fc836a5 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.781685] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c65a375-3f88-4860-998f-760c5fc836a5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.781727] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c65a375-3f88-4860-998f-760c5fc836a5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.781960] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c65a375-3f88-4860-998f-760c5fc836a5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.784151] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c65a375-3f88-4860-998f-760c5fc836a5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.819440] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f3cee614-ef84-4272-907d-71b07783fe81 [ 634.820109] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.820109] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.820109] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.820109] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.820109] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.820333] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f3cee614-ef84-4272-907d-71b07783fe81 already deleted. [ 634.820333] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3cee614-ef84-4272-907d-71b07783fe81" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.287350] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7c65a375-3f88-4860-998f-760c5fc836a5 [ 635.287948] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.287948] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.287948] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.287948] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.287948] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.288212] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7c65a375-3f88-4860-998f-760c5fc836a5 already deleted. [ 635.288212] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c65a375-3f88-4860-998f-760c5fc836a5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.812448] env[68328]: INFO networking_nsxv3.common.synchronization [None req-e8a0fc7e-704f-4d69-848a-446875444063 None None] Enqueued Resource ID: f5d12d45-b2d6-4236-947d-72f51f93b4cc with Priority: HIGHEST for action port [ 636.812728] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5d12d45-b2d6-4236-947d-72f51f93b4cc with Priority: HIGHEST for action port [ 636.813483] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-f5d12d45-b2d6-4236-947d-72f51f93b4cc taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.813483] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f5d12d45-b2d6-4236-947d-72f51f93b4cc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.813483] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f5d12d45-b2d6-4236-947d-72f51f93b4cc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.813736] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f5d12d45-b2d6-4236-947d-72f51f93b4cc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.813860] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5d12d45-b2d6-4236-947d-72f51f93b4cc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.320881] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f5d12d45-b2d6-4236-947d-72f51f93b4cc [ 637.320881] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.320881] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.320881] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.321112] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.321112] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.321185] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f5d12d45-b2d6-4236-947d-72f51f93b4cc already deleted. [ 637.321772] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f5d12d45-b2d6-4236-947d-72f51f93b4cc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.268329] env[68328]: INFO networking_nsxv3.common.synchronization [None req-fb228662-3664-4fc0-a1e4-ae9c915291d9 None None] Enqueued Resource ID: 6c11a691-4752-4d5a-b0c0-35ecc4d9550a with Priority: HIGHEST for action port [ 640.268923] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c11a691-4752-4d5a-b0c0-35ecc4d9550a with Priority: HIGHEST for action port [ 640.269289] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c11a691-4752-4d5a-b0c0-35ecc4d9550a taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.269589] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c11a691-4752-4d5a-b0c0-35ecc4d9550a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.269589] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c11a691-4752-4d5a-b0c0-35ecc4d9550a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.269827] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c11a691-4752-4d5a-b0c0-35ecc4d9550a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.269914] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c11a691-4752-4d5a-b0c0-35ecc4d9550a',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.571159] env[68328]: INFO networking_nsxv3.common.synchronization [None req-4e39de5d-ad1d-42fa-836d-d9fa3f69e7b7 None None] Enqueued Resource ID: 235e28bb-cf9f-4e50-951f-853c8d764018 with Priority: HIGHEST for action port [ 640.572641] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 235e28bb-cf9f-4e50-951f-853c8d764018 with Priority: HIGHEST for action port [ 640.573354] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-235e28bb-cf9f-4e50-951f-853c8d764018 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.573731] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-235e28bb-cf9f-4e50-951f-853c8d764018" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.573879] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-235e28bb-cf9f-4e50-951f-853c8d764018" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.574351] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-235e28bb-cf9f-4e50-951f-853c8d764018" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.574518] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('235e28bb-cf9f-4e50-951f-853c8d764018',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.773625] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6c11a691-4752-4d5a-b0c0-35ecc4d9550a [ 640.774409] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.774695] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.778394] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.778394] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.778394] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.778394] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6c11a691-4752-4d5a-b0c0-35ecc4d9550a already deleted. [ 640.778394] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c11a691-4752-4d5a-b0c0-35ecc4d9550a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.079453] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 235e28bb-cf9f-4e50-951f-853c8d764018 [ 641.079453] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.079453] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.079453] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.079453] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.079453] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.079453] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:235e28bb-cf9f-4e50-951f-853c8d764018 already deleted. [ 641.079453] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-235e28bb-cf9f-4e50-951f-853c8d764018" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.633844] env[68328]: INFO networking_nsxv3.common.synchronization [None req-a3ff0030-f5da-4847-a8e5-500216e3aa1d None None] Enqueued Resource ID: 8e84660a-e223-4819-bdb1-0ed1c32ceaca with Priority: HIGHEST for action port [ 641.634477] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e84660a-e223-4819-bdb1-0ed1c32ceaca with Priority: HIGHEST for action port [ 641.634889] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e84660a-e223-4819-bdb1-0ed1c32ceaca taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.635024] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e84660a-e223-4819-bdb1-0ed1c32ceaca" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.635325] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e84660a-e223-4819-bdb1-0ed1c32ceaca" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.635765] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e84660a-e223-4819-bdb1-0ed1c32ceaca" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.635765] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e84660a-e223-4819-bdb1-0ed1c32ceaca',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.139441] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8e84660a-e223-4819-bdb1-0ed1c32ceaca [ 642.139441] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.139441] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.139441] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.139441] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.139441] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.139441] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8e84660a-e223-4819-bdb1-0ed1c32ceaca already deleted. [ 642.139441] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e84660a-e223-4819-bdb1-0ed1c32ceaca" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.224935] env[68328]: INFO networking_nsxv3.common.synchronization [None req-33f28cdb-bec4-42a0-bd1e-bfef5a543140 None None] Enqueued Resource ID: ebfd85e5-f315-4084-8fd7-c2a2a6b3ae6b with Priority: HIGHEST for action port [ 642.224935] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebfd85e5-f315-4084-8fd7-c2a2a6b3ae6b with Priority: HIGHEST for action port [ 642.224935] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-ebfd85e5-f315-4084-8fd7-c2a2a6b3ae6b taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.224935] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ebfd85e5-f315-4084-8fd7-c2a2a6b3ae6b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.224935] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ebfd85e5-f315-4084-8fd7-c2a2a6b3ae6b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.224935] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ebfd85e5-f315-4084-8fd7-c2a2a6b3ae6b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.225294] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebfd85e5-f315-4084-8fd7-c2a2a6b3ae6b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.517359] env[68328]: INFO networking_nsxv3.common.synchronization [None req-03822caf-14e6-4549-9686-692c7619b444 None None] Enqueued Resource ID: bf320578-62a6-4b43-9055-91bb1c4d5ba4 with Priority: HIGHEST for action port [ 642.517359] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf320578-62a6-4b43-9055-91bb1c4d5ba4 with Priority: HIGHEST for action port [ 642.518302] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf320578-62a6-4b43-9055-91bb1c4d5ba4 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.518302] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf320578-62a6-4b43-9055-91bb1c4d5ba4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.518302] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf320578-62a6-4b43-9055-91bb1c4d5ba4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.518302] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf320578-62a6-4b43-9055-91bb1c4d5ba4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.518565] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf320578-62a6-4b43-9055-91bb1c4d5ba4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.727432] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ebfd85e5-f315-4084-8fd7-c2a2a6b3ae6b [ 642.727432] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.727432] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.727800] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.727800] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.727800] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.727892] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ebfd85e5-f315-4084-8fd7-c2a2a6b3ae6b already deleted. [ 642.727941] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ebfd85e5-f315-4084-8fd7-c2a2a6b3ae6b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.020682] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bf320578-62a6-4b43-9055-91bb1c4d5ba4 [ 643.021127] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.021334] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.021461] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.021716] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.021854] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.021987] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bf320578-62a6-4b43-9055-91bb1c4d5ba4 already deleted. [ 643.022130] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf320578-62a6-4b43-9055-91bb1c4d5ba4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.935301] env[68328]: INFO networking_nsxv3.common.synchronization [None req-34b05f67-9d97-44cb-bc9f-27a88f21550a None None] Enqueued Resource ID: f8a5f5fa-b6bf-4fcc-8c89-042d3f70741c with Priority: HIGHEST for action port [ 643.937048] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8a5f5fa-b6bf-4fcc-8c89-042d3f70741c with Priority: HIGHEST for action port [ 643.937048] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8a5f5fa-b6bf-4fcc-8c89-042d3f70741c taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.937048] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8a5f5fa-b6bf-4fcc-8c89-042d3f70741c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.937048] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8a5f5fa-b6bf-4fcc-8c89-042d3f70741c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.937048] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8a5f5fa-b6bf-4fcc-8c89-042d3f70741c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.937048] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8a5f5fa-b6bf-4fcc-8c89-042d3f70741c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.439901] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f8a5f5fa-b6bf-4fcc-8c89-042d3f70741c [ 644.442808] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.442808] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.442808] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.442808] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.442808] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.442808] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f8a5f5fa-b6bf-4fcc-8c89-042d3f70741c already deleted. [ 644.442808] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8a5f5fa-b6bf-4fcc-8c89-042d3f70741c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.773520] env[68328]: INFO networking_nsxv3.common.synchronization [None req-a165b382-ce0f-46ea-a306-8f39c47f0ffd None None] Enqueued Resource ID: 5e08fae2-4564-4fef-bf9d-1a4866660c29 with Priority: HIGHEST for action port [ 646.775459] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e08fae2-4564-4fef-bf9d-1a4866660c29 with Priority: HIGHEST for action port [ 646.775776] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e08fae2-4564-4fef-bf9d-1a4866660c29 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.775908] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e08fae2-4564-4fef-bf9d-1a4866660c29" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.776259] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e08fae2-4564-4fef-bf9d-1a4866660c29" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.776446] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e08fae2-4564-4fef-bf9d-1a4866660c29" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.776498] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e08fae2-4564-4fef-bf9d-1a4866660c29',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.278957] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5e08fae2-4564-4fef-bf9d-1a4866660c29 [ 647.279637] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.279923] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.280104] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.283420] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.283545] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.283830] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5e08fae2-4564-4fef-bf9d-1a4866660c29 already deleted. [ 647.283830] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e08fae2-4564-4fef-bf9d-1a4866660c29" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.680201] env[68328]: INFO networking_nsxv3.common.synchronization [None req-673ed8a5-ce1f-4147-9a5e-e9d0f6d7935d None None] Enqueued Resource ID: cdff887f-5c34-4bc5-945d-5bf5d0b35ab2 with Priority: HIGHEST for action port [ 647.680958] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdff887f-5c34-4bc5-945d-5bf5d0b35ab2 with Priority: HIGHEST for action port [ 647.681648] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-cdff887f-5c34-4bc5-945d-5bf5d0b35ab2 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.681648] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cdff887f-5c34-4bc5-945d-5bf5d0b35ab2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.681741] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cdff887f-5c34-4bc5-945d-5bf5d0b35ab2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.682649] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cdff887f-5c34-4bc5-945d-5bf5d0b35ab2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.682649] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cdff887f-5c34-4bc5-945d-5bf5d0b35ab2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.807190] env[68328]: INFO networking_nsxv3.common.synchronization [None req-55e371fa-5f97-4eff-90f9-49add55a7df6 None None] Enqueued Resource ID: b014adb5-8b4d-46f4-9998-3fe7f157850a with Priority: HIGHEST for action port [ 647.807190] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b014adb5-8b4d-46f4-9998-3fe7f157850a with Priority: HIGHEST for action port [ 647.809087] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-b014adb5-8b4d-46f4-9998-3fe7f157850a taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.809087] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b014adb5-8b4d-46f4-9998-3fe7f157850a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.809087] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b014adb5-8b4d-46f4-9998-3fe7f157850a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.809087] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b014adb5-8b4d-46f4-9998-3fe7f157850a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.809087] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b014adb5-8b4d-46f4-9998-3fe7f157850a',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.949098] env[68328]: INFO networking_nsxv3.common.synchronization [None req-ca89bf22-5ab8-44f9-a813-5c33f1c7fb10 None None] Enqueued Resource ID: 23118844-b14f-4e21-be94-1d2c093a5019 with Priority: HIGHEST for action port [ 647.949098] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23118844-b14f-4e21-be94-1d2c093a5019 with Priority: HIGHEST for action port [ 647.949098] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-23118844-b14f-4e21-be94-1d2c093a5019 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.949098] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23118844-b14f-4e21-be94-1d2c093a5019" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.949098] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23118844-b14f-4e21-be94-1d2c093a5019" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.949098] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23118844-b14f-4e21-be94-1d2c093a5019" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.949098] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23118844-b14f-4e21-be94-1d2c093a5019',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.184689] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cdff887f-5c34-4bc5-945d-5bf5d0b35ab2 [ 648.184936] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.185519] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.185651] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.186253] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.186253] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.186253] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cdff887f-5c34-4bc5-945d-5bf5d0b35ab2 already deleted. [ 648.186253] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cdff887f-5c34-4bc5-945d-5bf5d0b35ab2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.312785] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b014adb5-8b4d-46f4-9998-3fe7f157850a [ 648.312785] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.312785] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.312785] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.312785] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.312785] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.312785] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b014adb5-8b4d-46f4-9998-3fe7f157850a already deleted. [ 648.312785] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b014adb5-8b4d-46f4-9998-3fe7f157850a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.451660] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 23118844-b14f-4e21-be94-1d2c093a5019 [ 648.451926] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.452073] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.452162] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.452384] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.452473] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.452598] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:23118844-b14f-4e21-be94-1d2c093a5019 already deleted. [ 648.452690] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23118844-b14f-4e21-be94-1d2c093a5019" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.201892] env[68328]: INFO networking_nsxv3.common.synchronization [None req-374c581a-0ae7-400a-964c-355737d1fd7f None None] Enqueued Resource ID: a4b015ca-02e9-4041-9d6f-4f0270425b7a with Priority: HIGHEST for action port [ 649.203595] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4b015ca-02e9-4041-9d6f-4f0270425b7a with Priority: HIGHEST for action port [ 649.203595] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-a4b015ca-02e9-4041-9d6f-4f0270425b7a taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.203595] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a4b015ca-02e9-4041-9d6f-4f0270425b7a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.203595] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a4b015ca-02e9-4041-9d6f-4f0270425b7a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.205172] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a4b015ca-02e9-4041-9d6f-4f0270425b7a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.206030] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4b015ca-02e9-4041-9d6f-4f0270425b7a',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.388930] env[68328]: INFO networking_nsxv3.common.synchronization [None req-d5eeea37-dcd6-4512-bccd-6d6cb963c8be None None] Enqueued Resource ID: de5b6b9b-428e-4b6e-aa9b-1774d4909c6d with Priority: HIGHEST for action port [ 649.388930] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de5b6b9b-428e-4b6e-aa9b-1774d4909c6d with Priority: HIGHEST for action port [ 649.389428] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-de5b6b9b-428e-4b6e-aa9b-1774d4909c6d taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.389551] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de5b6b9b-428e-4b6e-aa9b-1774d4909c6d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.389617] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de5b6b9b-428e-4b6e-aa9b-1774d4909c6d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.389868] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de5b6b9b-428e-4b6e-aa9b-1774d4909c6d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.389946] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de5b6b9b-428e-4b6e-aa9b-1774d4909c6d',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.709116] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a4b015ca-02e9-4041-9d6f-4f0270425b7a [ 649.709116] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.711237] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.711353] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.713092] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.713092] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.713092] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a4b015ca-02e9-4041-9d6f-4f0270425b7a already deleted. [ 649.713092] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a4b015ca-02e9-4041-9d6f-4f0270425b7a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.895436] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port de5b6b9b-428e-4b6e-aa9b-1774d4909c6d [ 649.895682] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.895824] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.895915] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.896156] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.896246] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.897143] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:de5b6b9b-428e-4b6e-aa9b-1774d4909c6d already deleted. [ 649.897143] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de5b6b9b-428e-4b6e-aa9b-1774d4909c6d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.029248] env[68328]: INFO networking_nsxv3.common.synchronization [None req-3b39be7b-9820-41a2-bb26-778bbcf75a2d None None] Enqueued Resource ID: 19ee25e0-8649-4028-a427-83cb567d38bb with Priority: HIGHEST for action port [ 651.029248] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19ee25e0-8649-4028-a427-83cb567d38bb with Priority: HIGHEST for action port [ 651.029724] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-19ee25e0-8649-4028-a427-83cb567d38bb taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.029813] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-19ee25e0-8649-4028-a427-83cb567d38bb" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.030036] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-19ee25e0-8649-4028-a427-83cb567d38bb" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.030330] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-19ee25e0-8649-4028-a427-83cb567d38bb" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.030410] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19ee25e0-8649-4028-a427-83cb567d38bb',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.532701] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 19ee25e0-8649-4028-a427-83cb567d38bb [ 651.533014] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.533131] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.533195] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.533342] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.533428] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.533535] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:19ee25e0-8649-4028-a427-83cb567d38bb already deleted. [ 651.533598] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-19ee25e0-8649-4028-a427-83cb567d38bb" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.015161] env[68328]: INFO networking_nsxv3.common.synchronization [None req-9ea1a01a-c694-4f8c-be2e-94eefaad8f33 None None] Enqueued Resource ID: 324cb65d-5aa7-4f1a-867a-d0616b25cced with Priority: HIGHEST for action port [ 652.015494] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 324cb65d-5aa7-4f1a-867a-d0616b25cced with Priority: HIGHEST for action port [ 652.015975] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-324cb65d-5aa7-4f1a-867a-d0616b25cced taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.016125] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-324cb65d-5aa7-4f1a-867a-d0616b25cced" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.016170] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-324cb65d-5aa7-4f1a-867a-d0616b25cced" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.016431] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-324cb65d-5aa7-4f1a-867a-d0616b25cced" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.016508] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('324cb65d-5aa7-4f1a-867a-d0616b25cced',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.152808] env[68328]: INFO networking_nsxv3.common.synchronization [req-2d2ddd3a-18aa-4e9e-84f6-e1734ffac36e req-f70bff7e-4cf3-458c-804a-aa16e38ea9b2 tempest-ServersAdminNegativeTestJSON-100889397 tempest-ServersAdminNegativeTestJSON-100889397-project-member] Enqueued Resource ID: 55dff300-131a-42f9-920d-f2b5a3b91449 with Priority: HIGHEST for action security_group_members [ 652.154690] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55dff300-131a-42f9-920d-f2b5a3b91449 with Priority: HIGHEST for action security_group_members [ 652.156220] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-55dff300-131a-42f9-920d-f2b5a3b91449 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.156507] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.156507] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.157388] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.157388] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.157388] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.157388] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.157388] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.157388] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.157714] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55dff300-131a-42f9-920d-f2b5a3b91449',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.384426] env[68328]: INFO networking_nsxv3.common.synchronization [None req-13d58b80-d992-427e-b425-30f17796e0e2 None None] Enqueued Resource ID: ea8a1aaa-e7b1-40ca-ab04-31585ccf1d56 with Priority: HIGHEST for action port [ 652.384426] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea8a1aaa-e7b1-40ca-ab04-31585ccf1d56 with Priority: HIGHEST for action port [ 652.385312] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea8a1aaa-e7b1-40ca-ab04-31585ccf1d56 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.385429] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea8a1aaa-e7b1-40ca-ab04-31585ccf1d56" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.385510] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea8a1aaa-e7b1-40ca-ab04-31585ccf1d56" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.386183] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea8a1aaa-e7b1-40ca-ab04-31585ccf1d56" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.386366] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea8a1aaa-e7b1-40ca-ab04-31585ccf1d56',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.510079] env[68328]: INFO networking_nsxv3.common.synchronization [None req-d8a8cac6-d819-4d54-b78b-6e5754b133a6 None None] Enqueued Resource ID: 280dce5f-1534-4eb5-bbec-21fc4ed442ac with Priority: HIGHEST for action port [ 652.510079] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 280dce5f-1534-4eb5-bbec-21fc4ed442ac with Priority: HIGHEST for action port [ 652.510079] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-280dce5f-1534-4eb5-bbec-21fc4ed442ac taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.510079] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-280dce5f-1534-4eb5-bbec-21fc4ed442ac" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.510079] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-280dce5f-1534-4eb5-bbec-21fc4ed442ac" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.510079] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-280dce5f-1534-4eb5-bbec-21fc4ed442ac" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.510079] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('280dce5f-1534-4eb5-bbec-21fc4ed442ac',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.522268] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 324cb65d-5aa7-4f1a-867a-d0616b25cced [ 652.522726] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.522861] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.522930] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.523146] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.523239] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.523335] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:324cb65d-5aa7-4f1a-867a-d0616b25cced already deleted. [ 652.523414] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-324cb65d-5aa7-4f1a-867a-d0616b25cced" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.663647] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.663647] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.663647] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.663857] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.663948] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.664176] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.664369] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.664369] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.664540] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.664571] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.664750] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55dff300-131a-42f9-920d-f2b5a3b91449 already deleted. [ 652.664750] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.891390] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ea8a1aaa-e7b1-40ca-ab04-31585ccf1d56 [ 652.891640] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.891774] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.891851] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.892068] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.892154] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.892246] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ea8a1aaa-e7b1-40ca-ab04-31585ccf1d56 already deleted. [ 652.892327] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea8a1aaa-e7b1-40ca-ab04-31585ccf1d56" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.014016] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 280dce5f-1534-4eb5-bbec-21fc4ed442ac [ 653.014545] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.014880] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.015603] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.015849] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.015950] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.016072] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:280dce5f-1534-4eb5-bbec-21fc4ed442ac already deleted. [ 653.016535] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-280dce5f-1534-4eb5-bbec-21fc4ed442ac" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.324594] env[68328]: INFO networking_nsxv3.common.synchronization [None req-efcc1ba2-f41c-424c-a8bf-4bf66bc07d1d None None] Enqueued Resource ID: 7c140675-65f5-449c-b7ae-ad8753d816a5 with Priority: HIGHEST for action port [ 653.324594] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c140675-65f5-449c-b7ae-ad8753d816a5 with Priority: HIGHEST for action port [ 653.324910] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c140675-65f5-449c-b7ae-ad8753d816a5 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.325263] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c140675-65f5-449c-b7ae-ad8753d816a5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.326411] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c140675-65f5-449c-b7ae-ad8753d816a5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.326411] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c140675-65f5-449c-b7ae-ad8753d816a5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.326411] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c140675-65f5-449c-b7ae-ad8753d816a5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.627795] env[68328]: INFO networking_nsxv3.common.synchronization [None req-b746e311-3b51-4d56-8b84-d5f2e55f221d tempest-ServersTestBootFromVolume-1101005300 tempest-ServersTestBootFromVolume-1101005300-project-member] Enqueued Resource ID: 6e39d3b8-c430-4219-9295-992b699ce546 with Priority: HIGHEST for action security_group_rules [ 653.628334] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e39d3b8-c430-4219-9295-992b699ce546 with Priority: HIGHEST for action security_group_rules [ 653.628653] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e39d3b8-c430-4219-9295-992b699ce546 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.628780] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e39d3b8-c430-4219-9295-992b699ce546" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.628837] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e39d3b8-c430-4219-9295-992b699ce546" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.629301] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e39d3b8-c430-4219-9295-992b699ce546" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.629408] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e39d3b8-c430-4219-9295-992b699ce546',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.706770] env[68328]: INFO networking_nsxv3.common.synchronization [req-58b9bcb3-2d8b-4531-bb71-8fd6e832232b req-a9d92cb8-5c87-48ad-9d71-9ec0b8cf17d3 tempest-DeleteServersAdminTestJSON-355449425 tempest-DeleteServersAdminTestJSON-355449425-project-member] Enqueued Resource ID: f302de28-ce4b-4460-9ba9-d832cf4c957e with Priority: HIGHEST for action security_group_members [ 653.707364] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f302de28-ce4b-4460-9ba9-d832cf4c957e with Priority: HIGHEST for action security_group_members [ 653.707364] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-f302de28-ce4b-4460-9ba9-d832cf4c957e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.707514] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.707606] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.708588] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.708588] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.708588] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.708744] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.708775] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.709818] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.709818] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f302de28-ce4b-4460-9ba9-d832cf4c957e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.828578] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7c140675-65f5-449c-b7ae-ad8753d816a5 [ 653.828884] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.829090] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.829278] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.829436] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.829555] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.829669] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7c140675-65f5-449c-b7ae-ad8753d816a5 already deleted. [ 653.829756] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c140675-65f5-449c-b7ae-ad8753d816a5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.045728] env[68328]: INFO networking_nsxv3.common.synchronization [None req-af786b5c-baec-4d98-8571-a176de5b1ea5 tempest-ServersTestBootFromVolume-1101005300 tempest-ServersTestBootFromVolume-1101005300-project-member] Enqueued Resource ID: 6e39d3b8-c430-4219-9295-992b699ce546 with Priority: HIGHEST for action security_group_rules [ 654.046864] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e39d3b8-c430-4219-9295-992b699ce546 with Priority: HIGHEST for action security_group_rules [ 654.047193] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e39d3b8-c430-4219-9295-992b699ce546 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.047337] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e39d3b8-c430-4219-9295-992b699ce546" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.150686] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.151119] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.151119] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.151119] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.151227] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.151298] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e39d3b8-c430-4219-9295-992b699ce546 already deleted. [ 654.151328] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e39d3b8-c430-4219-9295-992b699ce546" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.151689] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e39d3b8-c430-4219-9295-992b699ce546" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.151689] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e39d3b8-c430-4219-9295-992b699ce546" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.152638] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e39d3b8-c430-4219-9295-992b699ce546',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.211047] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.214385] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.214385] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.214385] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.214385] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.214385] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.214385] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.214385] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.214385] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.214385] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.214385] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f302de28-ce4b-4460-9ba9-d832cf4c957e already deleted. [ 654.214385] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.414472] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-739 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.414806] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-739" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.415079] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-739" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.416034] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-739" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.416744] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.416949] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.417102] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.417366] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.418457] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.418457] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 654.418457] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 654.418457] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 654.418457] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 654.418457] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 654.418633] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 654.419737] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 654.439201] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 654.439455] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 654.439675] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 654.440058] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-739" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.440257] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-5f786447-b46e-47cb-8518-47c293a6ce49 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.440503] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-5f786447-b46e-47cb-8518-47c293a6ce49" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.441104] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-5f786447-b46e-47cb-8518-47c293a6ce49" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.441104] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-5f786447-b46e-47cb-8518-47c293a6ce49" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.441203] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f786447-b46e-47cb-8518-47c293a6ce49',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.673381] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.674433] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.674433] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.674433] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.674433] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.674683] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e39d3b8-c430-4219-9295-992b699ce546 already deleted. [ 654.674798] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e39d3b8-c430-4219-9295-992b699ce546" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.837013] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-739 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.837224] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-739" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.837351] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-739" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.837618] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-739" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.837946] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.838199] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.838331] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.838635] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.838777] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.838982] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 654.839109] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 654.840995] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 654.841078] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 654.841291] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 654.841347] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 654.841445] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 654.860774] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 654.861073] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 654.861134] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 654.861268] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-739" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.861577] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-e02d4804-9318-4112-a344-994fa22567e6 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.861748] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-e02d4804-9318-4112-a344-994fa22567e6" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.861936] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-e02d4804-9318-4112-a344-994fa22567e6" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.862226] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-e02d4804-9318-4112-a344-994fa22567e6" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.862375] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e02d4804-9318-4112-a344-994fa22567e6',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.945956] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.945956] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.945956] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.945956] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.945956] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.945956] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 5f786447-b46e-47cb-8518-47c293a6ce49 not found, creating... [ 654.947648] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.947648] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.947648] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.948445] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.948929] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.950086] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.950086] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.950086] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.950086] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.950790] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.951722] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 5f786447-b46e-47cb-8518-47c293a6ce49 is going to be created. [ 654.977319] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.977874] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.978548] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.978930] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.979882] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.980807] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-5f786447-b46e-47cb-8518-47c293a6ce49" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.108864] env[68328]: INFO networking_nsxv3.common.synchronization [None req-9a88c5ee-203f-4310-8c2e-40b20a147a9b None None] Enqueued Resource ID: 794dfc2a-ac58-46a0-a11c-5f790ee56c16 with Priority: HIGHEST for action port [ 655.112660] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 794dfc2a-ac58-46a0-a11c-5f790ee56c16 with Priority: HIGHEST for action port [ 655.113019] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-794dfc2a-ac58-46a0-a11c-5f790ee56c16 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.113124] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-794dfc2a-ac58-46a0-a11c-5f790ee56c16" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.113589] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-794dfc2a-ac58-46a0-a11c-5f790ee56c16" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.113589] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-794dfc2a-ac58-46a0-a11c-5f790ee56c16" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.113589] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('794dfc2a-ac58-46a0-a11c-5f790ee56c16',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.364426] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.364655] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.364785] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.365189] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.365275] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.365565] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port e02d4804-9318-4112-a344-994fa22567e6 not found, creating... [ 655.365712] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.366021] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.366021] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.366212] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.366347] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.366647] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.366794] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.366937] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.369068] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.370085] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.370085] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: e02d4804-9318-4112-a344-994fa22567e6 is going to be created. [ 655.394282] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.394282] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.394282] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.394282] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.394282] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.394282] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-e02d4804-9318-4112-a344-994fa22567e6" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.616342] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 794dfc2a-ac58-46a0-a11c-5f790ee56c16 [ 655.617484] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.617694] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.617778] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.617920] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.618025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.619059] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:794dfc2a-ac58-46a0-a11c-5f790ee56c16 already deleted. [ 655.619148] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-794dfc2a-ac58-46a0-a11c-5f790ee56c16" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.195525] env[68328]: INFO networking_nsxv3.common.synchronization [None req-18be78a4-b96e-40f7-9bf2-ecb8c784b708 None None] Enqueued Resource ID: abb123f1-8ede-4d7c-9843-c5c68d235819 with Priority: HIGHEST for action port [ 656.195773] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abb123f1-8ede-4d7c-9843-c5c68d235819 with Priority: HIGHEST for action port [ 656.196355] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-abb123f1-8ede-4d7c-9843-c5c68d235819 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.196496] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-abb123f1-8ede-4d7c-9843-c5c68d235819" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.196559] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-abb123f1-8ede-4d7c-9843-c5c68d235819" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.196808] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-abb123f1-8ede-4d7c-9843-c5c68d235819" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.196888] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abb123f1-8ede-4d7c-9843-c5c68d235819',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.232835] env[68328]: INFO networking_nsxv3.common.synchronization [None req-0f16be34-92df-4231-ac3e-a7dae02defb3 None None] Enqueued Resource ID: 7557d8ae-2676-498d-ad91-fcd5381a3969 with Priority: HIGHEST for action port [ 656.233386] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7557d8ae-2676-498d-ad91-fcd5381a3969 with Priority: HIGHEST for action port [ 656.233894] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-7557d8ae-2676-498d-ad91-fcd5381a3969 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.234484] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7557d8ae-2676-498d-ad91-fcd5381a3969" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.234596] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7557d8ae-2676-498d-ad91-fcd5381a3969" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.234850] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7557d8ae-2676-498d-ad91-fcd5381a3969" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.234932] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7557d8ae-2676-498d-ad91-fcd5381a3969',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.702746] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port abb123f1-8ede-4d7c-9843-c5c68d235819 [ 656.703013] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.703148] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.703221] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.703436] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.703529] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.703763] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:abb123f1-8ede-4d7c-9843-c5c68d235819 already deleted. [ 656.703763] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-abb123f1-8ede-4d7c-9843-c5c68d235819" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.738969] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7557d8ae-2676-498d-ad91-fcd5381a3969 [ 656.738969] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.739090] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.739090] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.739273] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.739355] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.739885] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7557d8ae-2676-498d-ad91-fcd5381a3969 already deleted. [ 656.739885] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7557d8ae-2676-498d-ad91-fcd5381a3969" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.068859] env[68328]: INFO networking_nsxv3.common.synchronization [None req-86dbecad-59aa-4c6d-a083-bfca9c9c8428 None None] Enqueued Resource ID: 83c5081d-8b79-4676-9e6b-ba7640e5611d with Priority: HIGHEST for action port [ 657.068859] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83c5081d-8b79-4676-9e6b-ba7640e5611d with Priority: HIGHEST for action port [ 657.068859] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-83c5081d-8b79-4676-9e6b-ba7640e5611d taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.068859] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83c5081d-8b79-4676-9e6b-ba7640e5611d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.068859] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83c5081d-8b79-4676-9e6b-ba7640e5611d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.068859] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83c5081d-8b79-4676-9e6b-ba7640e5611d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.068859] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83c5081d-8b79-4676-9e6b-ba7640e5611d',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.514177] env[68328]: INFO networking_nsxv3.common.synchronization [req-2d2ddd3a-18aa-4e9e-84f6-e1734ffac36e req-5f973ebc-643a-4a08-a44c-5f8203023878 service nova] Enqueued Resource ID: 55dff300-131a-42f9-920d-f2b5a3b91449 with Priority: HIGHEST for action security_group_rules [ 657.514597] env[68328]: INFO networking_nsxv3.common.synchronization [req-2d2ddd3a-18aa-4e9e-84f6-e1734ffac36e req-5f973ebc-643a-4a08-a44c-5f8203023878 service nova] Enqueued Resource ID: 55dff300-131a-42f9-920d-f2b5a3b91449 with Priority: HIGHEST for action security_group_members [ 657.514712] env[68328]: INFO networking_nsxv3.common.synchronization [req-2d2ddd3a-18aa-4e9e-84f6-e1734ffac36e req-5f973ebc-643a-4a08-a44c-5f8203023878 service nova] Enqueued Resource ID: 5f786447-b46e-47cb-8518-47c293a6ce49 with Priority: HIGHEST for action port [ 657.515325] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55dff300-131a-42f9-920d-f2b5a3b91449 with Priority: HIGHEST for action security_group_rules [ 657.515477] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55dff300-131a-42f9-920d-f2b5a3b91449 with Priority: HIGHEST for action security_group_members [ 657.515583] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f786447-b46e-47cb-8518-47c293a6ce49 with Priority: HIGHEST for action port [ 657.515932] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55dff300-131a-42f9-920d-f2b5a3b91449 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.516044] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.516081] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.516296] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.516382] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55dff300-131a-42f9-920d-f2b5a3b91449',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.517302] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-55dff300-131a-42f9-920d-f2b5a3b91449 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.517417] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.517485] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.517977] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.518152] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.518303] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.518337] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.518486] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.518646] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.518734] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55dff300-131a-42f9-920d-f2b5a3b91449',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.520241] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f786447-b46e-47cb-8518-47c293a6ce49 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.520351] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f786447-b46e-47cb-8518-47c293a6ce49" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.520420] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f786447-b46e-47cb-8518-47c293a6ce49" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.520578] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f786447-b46e-47cb-8518-47c293a6ce49" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.520651] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f786447-b46e-47cb-8518-47c293a6ce49',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.571653] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 83c5081d-8b79-4676-9e6b-ba7640e5611d [ 657.572364] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.572561] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.572633] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.578379] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.578379] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.578379] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:83c5081d-8b79-4676-9e6b-ba7640e5611d already deleted. [ 657.578379] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83c5081d-8b79-4676-9e6b-ba7640e5611d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.637439] env[68328]: INFO networking_nsxv3.common.synchronization [req-58b9bcb3-2d8b-4531-bb71-8fd6e832232b req-057cf22f-0d51-4fc3-9d14-b237d9b39412 service nova] Enqueued Resource ID: f302de28-ce4b-4460-9ba9-d832cf4c957e with Priority: HIGHEST for action security_group_rules [ 657.637439] env[68328]: INFO networking_nsxv3.common.synchronization [req-58b9bcb3-2d8b-4531-bb71-8fd6e832232b req-057cf22f-0d51-4fc3-9d14-b237d9b39412 service nova] Enqueued Resource ID: f302de28-ce4b-4460-9ba9-d832cf4c957e with Priority: HIGHEST for action security_group_members [ 657.637439] env[68328]: INFO networking_nsxv3.common.synchronization [req-58b9bcb3-2d8b-4531-bb71-8fd6e832232b req-057cf22f-0d51-4fc3-9d14-b237d9b39412 service nova] Enqueued Resource ID: e02d4804-9318-4112-a344-994fa22567e6 with Priority: HIGHEST for action port [ 657.637439] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f302de28-ce4b-4460-9ba9-d832cf4c957e with Priority: HIGHEST for action security_group_rules [ 657.637439] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f302de28-ce4b-4460-9ba9-d832cf4c957e with Priority: HIGHEST for action security_group_members [ 657.637439] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e02d4804-9318-4112-a344-994fa22567e6 with Priority: HIGHEST for action port [ 657.639066] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f302de28-ce4b-4460-9ba9-d832cf4c957e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.639339] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.639511] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.640775] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.640775] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f302de28-ce4b-4460-9ba9-d832cf4c957e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.641720] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-f302de28-ce4b-4460-9ba9-d832cf4c957e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.641853] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.641922] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.642126] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.642748] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.642748] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.642748] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.642748] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.642748] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.642987] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f302de28-ce4b-4460-9ba9-d832cf4c957e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.646833] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-e02d4804-9318-4112-a344-994fa22567e6 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.646833] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e02d4804-9318-4112-a344-994fa22567e6" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.646833] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e02d4804-9318-4112-a344-994fa22567e6" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.646833] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e02d4804-9318-4112-a344-994fa22567e6" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.646833] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e02d4804-9318-4112-a344-994fa22567e6',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.661300] env[68328]: INFO networking_nsxv3.common.synchronization [req-30e105ee-123c-41ae-97b0-fa1ea3c82b0a req-97044394-56d9-491d-b7bc-9de8be1be192 tempest-ServersAdminTestJSON-340534059 tempest-ServersAdminTestJSON-340534059-project-member] Enqueued Resource ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed with Priority: HIGHEST for action security_group_members [ 657.661300] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed with Priority: HIGHEST for action security_group_members [ 657.661300] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.661300] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.661300] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.661300] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.661300] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.661300] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.661300] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.661300] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.661300] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.664400] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.025468] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-55dff300-131a-42f9-920d-f2b5a3b91449 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.025822] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.037108] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5f786447-b46e-47cb-8518-47c293a6ce49 with status ACTIVE [ 658.040264] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.040264] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.040264] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.040264] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.040264] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.040264] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.040264] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.040264] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.040264] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.040264] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.040264] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.040264] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.040264] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.040264] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.040264] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.040264] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5f786447-b46e-47cb-8518-47c293a6ce49 is going to be updated. [ 658.044987] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55dff300-131a-42f9-920d-f2b5a3b91449',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.065659] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.065799] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.065860] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.066158] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.066360] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.067755] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f786447-b46e-47cb-8518-47c293a6ce49" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.150969] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f302de28-ce4b-4460-9ba9-d832cf4c957e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.150969] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-f302de28-ce4b-4460-9ba9-d832cf4c957e taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.150969] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.150969] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e02d4804-9318-4112-a344-994fa22567e6 with status ACTIVE [ 658.150969] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.150969] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.150969] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.150969] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.150969] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.150969] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.150969] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.150969] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.150969] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.152296] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.152670] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.155468] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.155468] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.155468] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.155468] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.155468] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e02d4804-9318-4112-a344-994fa22567e6 is going to be updated. [ 658.164744] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.164744] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.164744] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.165069] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.165223] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.165515] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.165898] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.166023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.166301] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.166422] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.166556] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed already deleted. [ 658.166685] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.174253] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.174396] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.174468] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.174666] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.174825] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.174960] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e02d4804-9318-4112-a344-994fa22567e6" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.548975] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55dff300-131a-42f9-920d-f2b5a3b91449',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.660212] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f302de28-ce4b-4460-9ba9-d832cf4c957e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.895714] env[68328]: INFO networking_nsxv3.common.synchronization [None req-764bd237-6a11-4a14-9c77-1aeda542276b None None] Enqueued Resource ID: f6df4f63-cfff-4706-979e-b3395654c5e5 with Priority: HIGHEST for action port [ 658.895714] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6df4f63-cfff-4706-979e-b3395654c5e5 with Priority: HIGHEST for action port [ 658.895714] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-f6df4f63-cfff-4706-979e-b3395654c5e5 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.895714] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f6df4f63-cfff-4706-979e-b3395654c5e5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.895714] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f6df4f63-cfff-4706-979e-b3395654c5e5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.895714] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f6df4f63-cfff-4706-979e-b3395654c5e5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.895714] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6df4f63-cfff-4706-979e-b3395654c5e5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.050625] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.051887] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.051887] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.051887] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.051887] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.051887] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55dff300-131a-42f9-920d-f2b5a3b91449 is going to be created. [ 659.079941] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.079941] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.079941] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.079941] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.080275] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.093130] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55dff300-131a-42f9-920d-f2b5a3b91449 in Status: UNINITIALIZED for 2s [ 659.163979] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.164808] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.164808] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.164808] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.164808] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.164808] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f302de28-ce4b-4460-9ba9-d832cf4c957e is going to be created. [ 659.190834] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-847 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.191652] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-847" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.191652] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-847" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.192078] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-847" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.192530] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.192748] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.192856] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.193468] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.193468] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.193468] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 659.193654] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 659.193765] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 659.193944] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 659.194094] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 659.194205] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 659.194345] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 659.208489] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.209085] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.209308] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.209441] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.209679] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.228091] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f302de28-ce4b-4460-9ba9-d832cf4c957e in Status: UNINITIALIZED for 2s [ 659.243070] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 659.243313] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.049 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 659.243451] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 659.243639] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-847" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.243984] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-4cfe031f-9c15-435a-adf2-da602449414e taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.244189] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-4cfe031f-9c15-435a-adf2-da602449414e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.244370] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-4cfe031f-9c15-435a-adf2-da602449414e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.244653] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-4cfe031f-9c15-435a-adf2-da602449414e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.244806] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4cfe031f-9c15-435a-adf2-da602449414e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.249803] env[68328]: INFO networking_nsxv3.common.synchronization [req-16f3f3f6-abcf-474f-a915-76cea759db98 req-f928f669-643b-45ef-bd8e-bfc60fe8beb8 tempest-SecurityGroupRulesTestJSON-182117541 tempest-SecurityGroupRulesTestJSON-182117541-project-member] Enqueued Resource ID: 6e9fa0f1-3b02-483c-b34f-3776f80406e2 with Priority: HIGHEST for action security_group_rules [ 659.250821] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e9fa0f1-3b02-483c-b34f-3776f80406e2 with Priority: HIGHEST for action security_group_rules [ 659.251195] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e9fa0f1-3b02-483c-b34f-3776f80406e2 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.251340] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e9fa0f1-3b02-483c-b34f-3776f80406e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.251407] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e9fa0f1-3b02-483c-b34f-3776f80406e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.251704] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e9fa0f1-3b02-483c-b34f-3776f80406e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.251766] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e9fa0f1-3b02-483c-b34f-3776f80406e2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.396461] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f6df4f63-cfff-4706-979e-b3395654c5e5 [ 659.396607] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.396750] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.396818] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.397048] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.397140] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.397235] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f6df4f63-cfff-4706-979e-b3395654c5e5 already deleted. [ 659.397314] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f6df4f63-cfff-4706-979e-b3395654c5e5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.746909] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.747639] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.747639] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.747639] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.747971] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.747971] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 4cfe031f-9c15-435a-adf2-da602449414e not found, creating... [ 659.748203] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.748359] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.748511] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.752021] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.752021] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.752021] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.752021] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.752021] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.752021] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.752021] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.752021] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 4cfe031f-9c15-435a-adf2-da602449414e is going to be created. [ 659.769848] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.770066] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.770191] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.770461] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.771371] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.771621] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-4cfe031f-9c15-435a-adf2-da602449414e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.774233] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.774354] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.774784] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.775111] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.775111] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.775217] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e9fa0f1-3b02-483c-b34f-3776f80406e2 already deleted. [ 659.775292] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e9fa0f1-3b02-483c-b34f-3776f80406e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.951681] env[68328]: INFO networking_nsxv3.common.synchronization [req-672135b7-c49f-4263-8764-d948221d14ab req-2115a625-feed-492a-9e09-de41381340f0 tempest-ServersAdminTestJSON-340534059 tempest-ServersAdminTestJSON-340534059-project-member] Enqueued Resource ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed with Priority: HIGHEST for action security_group_members [ 659.951681] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed with Priority: HIGHEST for action security_group_members [ 659.951681] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.951681] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.951681] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.954941] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.954941] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.954941] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.954941] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.954941] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.955261] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.955261] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.459621] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.459939] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.463898] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.463898] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.463898] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.463898] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.463898] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.463898] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.463898] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.463898] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.463898] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed already deleted. [ 660.463898] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.827145] env[68328]: INFO networking_nsxv3.common.synchronization [None req-7b66c2ce-48d8-41ac-b91f-f0eef1abe8cb None None] Enqueued Resource ID: 0808c7ad-deda-459f-8714-6e6d7c4e92f9 with Priority: HIGHEST for action port [ 660.827777] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0808c7ad-deda-459f-8714-6e6d7c4e92f9 with Priority: HIGHEST for action port [ 660.828106] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-0808c7ad-deda-459f-8714-6e6d7c4e92f9 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.828239] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0808c7ad-deda-459f-8714-6e6d7c4e92f9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.828307] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0808c7ad-deda-459f-8714-6e6d7c4e92f9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.828618] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0808c7ad-deda-459f-8714-6e6d7c4e92f9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.828722] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0808c7ad-deda-459f-8714-6e6d7c4e92f9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.874722] env[68328]: INFO networking_nsxv3.common.synchronization [None req-f50cad4c-83ae-4293-b007-93536ffde2bd None None] Enqueued Resource ID: 2ed56f57-d011-4c41-8aec-affdb4d553b4 with Priority: HIGHEST for action port [ 660.878022] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ed56f57-d011-4c41-8aec-affdb4d553b4 with Priority: HIGHEST for action port [ 660.878022] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ed56f57-d011-4c41-8aec-affdb4d553b4 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.878022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ed56f57-d011-4c41-8aec-affdb4d553b4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.878022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ed56f57-d011-4c41-8aec-affdb4d553b4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.878022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ed56f57-d011-4c41-8aec-affdb4d553b4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.878022] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ed56f57-d011-4c41-8aec-affdb4d553b4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.107679] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55dff300-131a-42f9-920d-f2b5a3b91449 in Status: SUCCESS [ 661.108026] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.108301] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.108554] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.108828] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.108976] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.109064] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.109257] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.109400] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.109495] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.109594] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('55dff300-131a-42f9-920d-f2b5a3b91449',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.239294] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f302de28-ce4b-4460-9ba9-d832cf4c957e in Status: SUCCESS [ 661.239294] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.239294] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.239294] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.239294] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.239294] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.240600] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.241697] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.241697] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.241697] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.241697] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f302de28-ce4b-4460-9ba9-d832cf4c957e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.307295] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-847 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.307604] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-847" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.307769] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-847" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.307916] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-847" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.308254] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.308492] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.308595] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.308821] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.308970] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.309898] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 661.309996] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 661.310138] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 661.310246] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 661.310596] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 661.310596] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 661.310741] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 661.331953] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 661.331953] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 661.331953] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 661.331953] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-847" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.332330] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-93c282d3-1e15-433e-8252-922d09d6467b taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.332514] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-93c282d3-1e15-433e-8252-922d09d6467b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.333577] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-93c282d3-1e15-433e-8252-922d09d6467b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.333577] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-93c282d3-1e15-433e-8252-922d09d6467b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.333577] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93c282d3-1e15-433e-8252-922d09d6467b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.334829] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0808c7ad-deda-459f-8714-6e6d7c4e92f9 [ 661.335531] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.335666] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.335800] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.335914] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.336022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.336106] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0808c7ad-deda-459f-8714-6e6d7c4e92f9 already deleted. [ 661.336173] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0808c7ad-deda-459f-8714-6e6d7c4e92f9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.380782] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2ed56f57-d011-4c41-8aec-affdb4d553b4 [ 661.381036] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.381167] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.381235] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.381443] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.381544] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.381719] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2ed56f57-d011-4c41-8aec-affdb4d553b4 already deleted. [ 661.381719] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ed56f57-d011-4c41-8aec-affdb4d553b4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.498080] env[68328]: INFO networking_nsxv3.common.synchronization [None req-b7fdb5a5-a144-4272-8e0e-b2e0cd4105f4 tempest-ServerActionsV293TestJSON-674787330 tempest-ServerActionsV293TestJSON-674787330-project-member] Enqueued Resource ID: 24a59c7c-3185-4ae4-af15-7deeba4a037c with Priority: HIGHEST for action security_group_rules [ 661.498724] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24a59c7c-3185-4ae4-af15-7deeba4a037c with Priority: HIGHEST for action security_group_rules [ 661.499595] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24a59c7c-3185-4ae4-af15-7deeba4a037c taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.499759] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24a59c7c-3185-4ae4-af15-7deeba4a037c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.499839] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24a59c7c-3185-4ae4-af15-7deeba4a037c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.500111] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24a59c7c-3185-4ae4-af15-7deeba4a037c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.500310] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24a59c7c-3185-4ae4-af15-7deeba4a037c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.615492] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-55dff300-131a-42f9-920d-f2b5a3b91449 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.615584] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.616223] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.616223] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.616389] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.616389] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.616490] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.617078] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.617078] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.617078] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.617411] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-55dff300-131a-42f9-920d-f2b5a3b91449 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.617516] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.617618] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.617821] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.618109] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.618109] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.618289] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.618289] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.618358] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.618539] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.618612] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('55dff300-131a-42f9-920d-f2b5a3b91449',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.747399] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-f302de28-ce4b-4460-9ba9-d832cf4c957e taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.747562] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.747634] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.748060] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.748060] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.748483] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.748483] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.748483] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.749197] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.749197] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.749197] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-f302de28-ce4b-4460-9ba9-d832cf4c957e taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.749351] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.749351] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.749591] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.749813] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.749957] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.751993] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.751993] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.751993] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.752490] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.752717] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f302de28-ce4b-4460-9ba9-d832cf4c957e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.813724] env[68328]: INFO networking_nsxv3.common.synchronization [None req-2c6c2e65-8d8b-4218-af3b-90de6a9b34dc tempest-ServerActionsV293TestJSON-674787330 tempest-ServerActionsV293TestJSON-674787330-project-member] Enqueued Resource ID: 24a59c7c-3185-4ae4-af15-7deeba4a037c with Priority: HIGHEST for action security_group_rules [ 661.814347] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24a59c7c-3185-4ae4-af15-7deeba4a037c with Priority: HIGHEST for action security_group_rules [ 661.814692] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24a59c7c-3185-4ae4-af15-7deeba4a037c taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.814807] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24a59c7c-3185-4ae4-af15-7deeba4a037c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.836721] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.836958] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.837102] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.837417] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.837610] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.837832] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 93c282d3-1e15-433e-8252-922d09d6467b not found, creating... [ 661.838106] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.838330] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.838409] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.838753] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.838931] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.840939] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.841146] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.841275] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.841539] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.841908] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.842106] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 93c282d3-1e15-433e-8252-922d09d6467b is going to be created. [ 661.861194] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.861522] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.862022] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.862335] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.862573] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.862939] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-93c282d3-1e15-433e-8252-922d09d6467b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.006728] env[68328]: INFO networking_nsxv3.common.synchronization [req-30e105ee-123c-41ae-97b0-fa1ea3c82b0a req-95ae1f8c-2f99-45ab-93cd-d1e60da1c1b1 service nova] Enqueued Resource ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed with Priority: HIGHEST for action security_group_rules [ 662.006728] env[68328]: INFO networking_nsxv3.common.synchronization [req-30e105ee-123c-41ae-97b0-fa1ea3c82b0a req-95ae1f8c-2f99-45ab-93cd-d1e60da1c1b1 service nova] Enqueued Resource ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed with Priority: HIGHEST for action security_group_members [ 662.006856] env[68328]: INFO networking_nsxv3.common.synchronization [req-30e105ee-123c-41ae-97b0-fa1ea3c82b0a req-95ae1f8c-2f99-45ab-93cd-d1e60da1c1b1 service nova] Enqueued Resource ID: 4cfe031f-9c15-435a-adf2-da602449414e with Priority: HIGHEST for action port [ 662.009216] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed with Priority: HIGHEST for action security_group_rules [ 662.009839] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed with Priority: HIGHEST for action security_group_members [ 662.010198] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cfe031f-9c15-435a-adf2-da602449414e with Priority: HIGHEST for action port [ 662.010292] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.010423] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.010508] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.010754] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.010870] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.011705] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.011827] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.011889] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.012582] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.012771] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.013026] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.013100] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.013350] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.013350] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.013461] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.014452] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-4cfe031f-9c15-435a-adf2-da602449414e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.014703] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4cfe031f-9c15-435a-adf2-da602449414e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.014703] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4cfe031f-9c15-435a-adf2-da602449414e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.014829] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4cfe031f-9c15-435a-adf2-da602449414e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.014893] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4cfe031f-9c15-435a-adf2-da602449414e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.025480] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.027211] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.027320] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.027530] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.027627] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.027724] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24a59c7c-3185-4ae4-af15-7deeba4a037c already deleted. [ 662.027799] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24a59c7c-3185-4ae4-af15-7deeba4a037c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.028875] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24a59c7c-3185-4ae4-af15-7deeba4a037c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.029136] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24a59c7c-3185-4ae4-af15-7deeba4a037c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.029193] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24a59c7c-3185-4ae4-af15-7deeba4a037c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.125487] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 55dff300-131a-42f9-920d-f2b5a3b91449: rpc.has_security_group_logging(os_id): False [ 662.145054] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.145054] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.145054] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.145054] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.145054] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.145054] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.145054] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.145054] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.145054] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.145054] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.145054] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.145054] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.145054] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.145054] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.145054] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.146262] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.146262] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.146262] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.146262] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.146262] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.146262] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55dff300-131a-42f9-920d-f2b5a3b91449 is going to be created. [ 662.203735] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.203902] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.203974] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.204245] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.204506] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.216011] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55dff300-131a-42f9-920d-f2b5a3b91449 in Status: IN_PROGRESS for 2s [ 662.255668] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f302de28-ce4b-4460-9ba9-d832cf4c957e: rpc.has_security_group_logging(os_id): False [ 662.272626] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.272796] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.272835] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.273112] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.273242] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.273521] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.273638] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.273702] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.273878] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.273959] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.274152] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.274243] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.274302] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.274443] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.274516] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.274691] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.274773] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.274832] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.274969] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.275574] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.275706] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f302de28-ce4b-4460-9ba9-d832cf4c957e is going to be created. [ 662.349917] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.350298] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.350531] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.351088] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.351580] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.365688] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f302de28-ce4b-4460-9ba9-d832cf4c957e in Status: IN_PROGRESS for 2s [ 662.516188] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.516488] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.516570] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.517522] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4cfe031f-9c15-435a-adf2-da602449414e with status ACTIVE [ 662.517723] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.517831] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.517915] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.518424] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.518528] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.518704] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.518806] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.518869] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.519198] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.519306] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.519529] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.519629] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.519692] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.519855] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.519941] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.520044] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4cfe031f-9c15-435a-adf2-da602449414e is going to be updated. [ 662.527041] env[68328]: INFO networking_nsxv3.common.synchronization [None req-52af87de-c500-43ba-bfe6-7afa2c3a016a None None] Enqueued Resource ID: 6382d4c1-845f-4720-94ff-c31e7b07cd8c with Priority: HIGHEST for action port [ 662.527041] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6382d4c1-845f-4720-94ff-c31e7b07cd8c with Priority: HIGHEST for action port [ 662.527780] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-6382d4c1-845f-4720-94ff-c31e7b07cd8c taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.528371] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6382d4c1-845f-4720-94ff-c31e7b07cd8c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.528474] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6382d4c1-845f-4720-94ff-c31e7b07cd8c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.528849] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6382d4c1-845f-4720-94ff-c31e7b07cd8c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.528934] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6382d4c1-845f-4720-94ff-c31e7b07cd8c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.551941] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.551941] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.552048] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.552277] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.552337] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.552593] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24a59c7c-3185-4ae4-af15-7deeba4a037c already deleted. [ 662.552736] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24a59c7c-3185-4ae4-af15-7deeba4a037c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.556064] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.556519] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.556519] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.556519] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.556714] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.556767] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4cfe031f-9c15-435a-adf2-da602449414e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.793615] env[68328]: INFO networking_nsxv3.common.synchronization [None req-eea5419a-6a51-44ee-b365-ddd86243a6af None None] Enqueued Resource ID: 82752656-9940-494e-b499-6a50ddca1606 with Priority: HIGHEST for action port [ 662.793703] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82752656-9940-494e-b499-6a50ddca1606 with Priority: HIGHEST for action port [ 662.794280] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-82752656-9940-494e-b499-6a50ddca1606 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.794404] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82752656-9940-494e-b499-6a50ddca1606" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.794471] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82752656-9940-494e-b499-6a50ddca1606" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.795039] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82752656-9940-494e-b499-6a50ddca1606" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.795039] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82752656-9940-494e-b499-6a50ddca1606',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.021645] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.031059] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6382d4c1-845f-4720-94ff-c31e7b07cd8c [ 663.031291] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.031430] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.031512] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.031725] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.031874] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.031938] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6382d4c1-845f-4720-94ff-c31e7b07cd8c already deleted. [ 663.031998] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6382d4c1-845f-4720-94ff-c31e7b07cd8c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.298480] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 82752656-9940-494e-b499-6a50ddca1606 [ 663.298480] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.298480] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.298480] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.298480] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.298480] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.298480] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:82752656-9940-494e-b499-6a50ddca1606 already deleted. [ 663.298480] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82752656-9940-494e-b499-6a50ddca1606" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.523594] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.524389] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.524389] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.524389] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.524529] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.524677] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed is going to be created. [ 663.553922] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.553922] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.553922] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.553922] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.553922] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.563465] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed in Status: UNINITIALIZED for 2s [ 663.619773] env[68328]: INFO networking_nsxv3.common.synchronization [req-ecd64cef-15d0-4058-a3f8-5dfb3b9a9c78 req-5b174eb0-a41d-4c66-8066-8285bc35149a tempest-SecurityGroupRulesTestJSON-182117541 tempest-SecurityGroupRulesTestJSON-182117541-project-member] Enqueued Resource ID: 6a21616b-8045-4dc5-a335-40ce0160a97e with Priority: HIGHEST for action security_group_rules [ 663.620354] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a21616b-8045-4dc5-a335-40ce0160a97e with Priority: HIGHEST for action security_group_rules [ 663.620936] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a21616b-8045-4dc5-a335-40ce0160a97e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.621148] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a21616b-8045-4dc5-a335-40ce0160a97e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.621216] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a21616b-8045-4dc5-a335-40ce0160a97e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.621459] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a21616b-8045-4dc5-a335-40ce0160a97e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.621534] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a21616b-8045-4dc5-a335-40ce0160a97e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.725337] env[68328]: INFO networking_nsxv3.common.synchronization [None req-dac264d0-ca4c-4a83-8a53-7266c02a014c tempest-VolumesAssistedSnapshotsTest-819686352 tempest-VolumesAssistedSnapshotsTest-819686352-project-member] Enqueued Resource ID: 57b7bbe5-8e54-4d67-b8c6-8cfc418f7042 with Priority: HIGHEST for action security_group_rules [ 663.725810] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57b7bbe5-8e54-4d67-b8c6-8cfc418f7042 with Priority: HIGHEST for action security_group_rules [ 663.727032] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57b7bbe5-8e54-4d67-b8c6-8cfc418f7042 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.727032] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57b7bbe5-8e54-4d67-b8c6-8cfc418f7042" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.727032] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57b7bbe5-8e54-4d67-b8c6-8cfc418f7042" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.727032] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57b7bbe5-8e54-4d67-b8c6-8cfc418f7042" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.727032] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57b7bbe5-8e54-4d67-b8c6-8cfc418f7042',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.151705] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.151966] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.151966] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.152215] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.152312] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.152430] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a21616b-8045-4dc5-a335-40ce0160a97e already deleted. [ 664.152554] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a21616b-8045-4dc5-a335-40ce0160a97e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.238186] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55dff300-131a-42f9-920d-f2b5a3b91449 in Status: SUCCESS [ 664.238186] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.268174] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.268737] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.268737] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.268737] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.268867] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.268867] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57b7bbe5-8e54-4d67-b8c6-8cfc418f7042 already deleted. [ 664.268964] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57b7bbe5-8e54-4d67-b8c6-8cfc418f7042" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.331217] env[68328]: INFO networking_nsxv3.common.synchronization [None req-da6b4dbf-e978-4f80-b04d-82616505a7be tempest-VolumesAssistedSnapshotsTest-819686352 tempest-VolumesAssistedSnapshotsTest-819686352-project-member] Enqueued Resource ID: 57b7bbe5-8e54-4d67-b8c6-8cfc418f7042 with Priority: HIGHEST for action security_group_rules [ 664.332110] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57b7bbe5-8e54-4d67-b8c6-8cfc418f7042 with Priority: HIGHEST for action security_group_rules [ 664.332586] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57b7bbe5-8e54-4d67-b8c6-8cfc418f7042 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.332770] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57b7bbe5-8e54-4d67-b8c6-8cfc418f7042" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.332879] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57b7bbe5-8e54-4d67-b8c6-8cfc418f7042" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.333357] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57b7bbe5-8e54-4d67-b8c6-8cfc418f7042" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.333520] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57b7bbe5-8e54-4d67-b8c6-8cfc418f7042',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.382070] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f302de28-ce4b-4460-9ba9-d832cf4c957e in Status: SUCCESS [ 664.382328] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.400852] env[68328]: INFO networking_nsxv3.common.synchronization [req-672135b7-c49f-4263-8764-d948221d14ab req-5d6d6eb2-286b-4123-9e67-aedc2c2ebbf3 service nova] Enqueued Resource ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed with Priority: HIGHEST for action security_group_rules [ 664.401052] env[68328]: INFO networking_nsxv3.common.synchronization [req-672135b7-c49f-4263-8764-d948221d14ab req-5d6d6eb2-286b-4123-9e67-aedc2c2ebbf3 service nova] Enqueued Resource ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed with Priority: HIGHEST for action security_group_members [ 664.401194] env[68328]: INFO networking_nsxv3.common.synchronization [req-672135b7-c49f-4263-8764-d948221d14ab req-5d6d6eb2-286b-4123-9e67-aedc2c2ebbf3 service nova] Enqueued Resource ID: 93c282d3-1e15-433e-8252-922d09d6467b with Priority: HIGHEST for action port [ 664.405020] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed with Priority: HIGHEST for action security_group_rules [ 664.405020] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed with Priority: HIGHEST for action security_group_members [ 664.405020] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93c282d3-1e15-433e-8252-922d09d6467b with Priority: HIGHEST for action port [ 664.405020] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.405020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.405020] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.405020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.405020] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-93c282d3-1e15-433e-8252-922d09d6467b taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.405020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-93c282d3-1e15-433e-8252-922d09d6467b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.405020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-93c282d3-1e15-433e-8252-922d09d6467b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.405020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-93c282d3-1e15-433e-8252-922d09d6467b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.405020] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93c282d3-1e15-433e-8252-922d09d6467b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.854964] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.854964] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.854964] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.854964] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.854964] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.854964] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57b7bbe5-8e54-4d67-b8c6-8cfc418f7042 already deleted. [ 664.854964] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57b7bbe5-8e54-4d67-b8c6-8cfc418f7042" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.870329] env[68328]: INFO networking_nsxv3.common.synchronization [None req-ac2b8321-3276-4e18-8921-d5b97a805e8a None None] Enqueued Resource ID: 335f8deb-d7b1-4a09-b46b-50c2f1462882 with Priority: HIGHEST for action port [ 664.870822] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 335f8deb-d7b1-4a09-b46b-50c2f1462882 with Priority: HIGHEST for action port [ 664.872723] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-335f8deb-d7b1-4a09-b46b-50c2f1462882 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.872723] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-335f8deb-d7b1-4a09-b46b-50c2f1462882" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.873075] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-335f8deb-d7b1-4a09-b46b-50c2f1462882" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.873141] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-335f8deb-d7b1-4a09-b46b-50c2f1462882" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.873226] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('335f8deb-d7b1-4a09-b46b-50c2f1462882',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.906949] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 93c282d3-1e15-433e-8252-922d09d6467b with status ACTIVE [ 664.907230] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.907369] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.907455] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.907680] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.907788] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.907992] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.908124] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.908175] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.908404] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.908404] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.908749] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.908749] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.908968] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.908968] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.909233] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.909233] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 93c282d3-1e15-433e-8252-922d09d6467b is going to be updated. [ 664.936311] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.936513] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.936584] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.936907] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.936989] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.937130] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-93c282d3-1e15-433e-8252-922d09d6467b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.375834] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 335f8deb-d7b1-4a09-b46b-50c2f1462882 [ 665.376321] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.376321] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.376484] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.380025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.380025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.380025] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:335f8deb-d7b1-4a09-b46b-50c2f1462882 already deleted. [ 665.380025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-335f8deb-d7b1-4a09-b46b-50c2f1462882" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.416060] env[68328]: INFO networking_nsxv3.common.synchronization [None req-978eac27-94e1-4005-aa0d-6115f502c318 tempest-ServersWithSpecificFlavorTestJSON-2033217338 tempest-ServersWithSpecificFlavorTestJSON-2033217338-project-member] Enqueued Resource ID: 3e399462-679e-43d6-8b03-2876938fc726 with Priority: HIGHEST for action security_group_rules [ 665.416060] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e399462-679e-43d6-8b03-2876938fc726 with Priority: HIGHEST for action security_group_rules [ 665.416060] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e399462-679e-43d6-8b03-2876938fc726 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.416875] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.417037] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.417617] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.417617] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e399462-679e-43d6-8b03-2876938fc726',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.576548] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed in Status: SUCCESS [ 665.576779] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.576929] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.577167] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.577371] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.577465] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.577532] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.577686] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.577768] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.577854] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.577980] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.578842] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.579022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.584309] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.584309] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.584309] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.584309] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.584309] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.584309] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.938362] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.938736] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.938736] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.939117] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.939328] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.939421] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e399462-679e-43d6-8b03-2876938fc726 already deleted. [ 665.939532] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.987901] env[68328]: INFO networking_nsxv3.common.synchronization [None req-d772797c-4aac-4d04-bf07-466602ddb0bc tempest-ServersWithSpecificFlavorTestJSON-2033217338 tempest-ServersWithSpecificFlavorTestJSON-2033217338-project-member] Enqueued Resource ID: 3e399462-679e-43d6-8b03-2876938fc726 with Priority: HIGHEST for action security_group_rules [ 665.987901] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e399462-679e-43d6-8b03-2876938fc726 with Priority: HIGHEST for action security_group_rules [ 665.987901] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e399462-679e-43d6-8b03-2876938fc726 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.987901] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.987901] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.988189] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.988251] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e399462-679e-43d6-8b03-2876938fc726',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.086039] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.087898] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.087898] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.347307] env[68328]: INFO networking_nsxv3.common.synchronization [None req-749ee027-16f1-46ea-8dd3-067b6729edf5 None None] Enqueued Resource ID: 5fa076c1-2fc5-4eab-b06d-96bf1b7283c4 with Priority: HIGHEST for action port [ 666.347838] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fa076c1-2fc5-4eab-b06d-96bf1b7283c4 with Priority: HIGHEST for action port [ 666.348165] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-5fa076c1-2fc5-4eab-b06d-96bf1b7283c4 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.348317] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5fa076c1-2fc5-4eab-b06d-96bf1b7283c4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.348396] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5fa076c1-2fc5-4eab-b06d-96bf1b7283c4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.348680] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5fa076c1-2fc5-4eab-b06d-96bf1b7283c4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.348768] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5fa076c1-2fc5-4eab-b06d-96bf1b7283c4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.511537] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.511537] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.511537] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.511537] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.511537] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.511537] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e399462-679e-43d6-8b03-2876938fc726 already deleted. [ 666.511537] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.591348] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.851375] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5fa076c1-2fc5-4eab-b06d-96bf1b7283c4 [ 666.851660] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.851786] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.851786] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.852008] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.852112] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.852228] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5fa076c1-2fc5-4eab-b06d-96bf1b7283c4 already deleted. [ 666.852327] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5fa076c1-2fc5-4eab-b06d-96bf1b7283c4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.097051] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.097396] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.097444] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.097717] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.097924] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.097924] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed is going to be updated. [ 667.126331] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.126331] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.126331] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.126331] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.126331] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.134531] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed in Status: IN_PROGRESS for 2s [ 667.319211] env[68328]: INFO networking_nsxv3.common.synchronization [req-b6093b30-4651-41e7-9f36-a49a960b50d8 req-470240e9-2bdb-4d2a-8239-2cedd3daf360 tempest-ServersTestMultiNic-360170984 tempest-ServersTestMultiNic-360170984-project-member] Enqueued Resource ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc with Priority: HIGHEST for action security_group_members [ 667.319211] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc with Priority: HIGHEST for action security_group_members [ 667.319211] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.319211] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.319211] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.319211] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.319211] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.319211] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.319211] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.319211] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.319846] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.320068] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba6f8661-b38c-4d97-a1c5-4a0e33e341bc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.540587] env[68328]: INFO networking_nsxv3.common.synchronization [req-5b5bdff9-0db0-4f0a-9753-f98d1ffd378a req-5a3e10ef-d804-4ed6-9a49-b27a3353363c tempest-SecurityGroupRulesNegativeTestJSON-1570722059 tempest-SecurityGroupRulesNegativeTestJSON-1570722059-project-member] Enqueued Resource ID: 13b9e468-1742-4ecd-a19c-a16df2668997 with Priority: HIGHEST for action security_group_rules [ 667.541200] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13b9e468-1742-4ecd-a19c-a16df2668997 with Priority: HIGHEST for action security_group_rules [ 667.541534] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-13b9e468-1742-4ecd-a19c-a16df2668997 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.541677] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-13b9e468-1742-4ecd-a19c-a16df2668997" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.544031] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-13b9e468-1742-4ecd-a19c-a16df2668997" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.544031] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-13b9e468-1742-4ecd-a19c-a16df2668997" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.544031] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('13b9e468-1742-4ecd-a19c-a16df2668997',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.824476] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.824476] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.824476] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.824476] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.824476] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.824476] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.824476] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.824476] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.824476] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.824476] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.824476] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc already deleted. [ 667.824476] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.064930] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.067042] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.067042] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.067335] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.067335] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.067437] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 13b9e468-1742-4ecd-a19c-a16df2668997 already deleted. [ 668.067483] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-13b9e468-1742-4ecd-a19c-a16df2668997" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.236640] env[68328]: INFO networking_nsxv3.common.synchronization [None req-85fe829f-4ad9-4fd2-ae86-9334d1c47d28 None None] Enqueued Resource ID: 1a598432-e778-4bd9-ad90-c89f07d17cb9 with Priority: HIGHEST for action port [ 668.236640] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a598432-e778-4bd9-ad90-c89f07d17cb9 with Priority: HIGHEST for action port [ 668.239306] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a598432-e778-4bd9-ad90-c89f07d17cb9 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.239306] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a598432-e778-4bd9-ad90-c89f07d17cb9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.240927] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a598432-e778-4bd9-ad90-c89f07d17cb9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.241133] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a598432-e778-4bd9-ad90-c89f07d17cb9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.241601] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a598432-e778-4bd9-ad90-c89f07d17cb9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.743885] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1a598432-e778-4bd9-ad90-c89f07d17cb9 [ 668.745302] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.745302] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.745302] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.745302] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.745302] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.745302] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1a598432-e778-4bd9-ad90-c89f07d17cb9 already deleted. [ 668.745302] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a598432-e778-4bd9-ad90-c89f07d17cb9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.147379] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed in Status: SUCCESS [ 669.147630] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.147817] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.148167] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.148215] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.148294] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.148358] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.148510] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.148957] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.148957] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.148957] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.148957] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.148957] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.149198] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.149254] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.149340] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.149394] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.149556] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.149609] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.150103] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.150103] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.348060] env[68328]: INFO networking_nsxv3.common.synchronization [None req-929db866-b34a-414a-b6a9-452982956c28 None None] Enqueued Resource ID: 7e55e718-332b-4e94-bcb3-aba20ebe9549 with Priority: HIGHEST for action port [ 669.348060] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e55e718-332b-4e94-bcb3-aba20ebe9549 with Priority: HIGHEST for action port [ 669.348060] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e55e718-332b-4e94-bcb3-aba20ebe9549 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.348060] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e55e718-332b-4e94-bcb3-aba20ebe9549" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.348060] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e55e718-332b-4e94-bcb3-aba20ebe9549" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.349207] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e55e718-332b-4e94-bcb3-aba20ebe9549" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.349447] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e55e718-332b-4e94-bcb3-aba20ebe9549',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.655386] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed: rpc.has_security_group_logging(os_id): False [ 669.676299] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.676299] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.676299] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.676299] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.676299] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.676299] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.676299] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.676299] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.676299] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.676299] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.676299] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.676299] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.676299] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.678529] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.678529] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.678529] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.678858] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.679013] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.679560] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.679815] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.680141] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed is going to be created. [ 669.737706] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.737911] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.738026] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.738294] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.738494] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.753604] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed in Status: IN_PROGRESS for 2s [ 669.810286] env[68328]: INFO networking_nsxv3.common.synchronization [req-b6093b30-4651-41e7-9f36-a49a960b50d8 req-10cf1b40-1006-4998-b7b2-3f32532249e4 tempest-ServersTestMultiNic-360170984 tempest-ServersTestMultiNic-360170984-project-member] Enqueued Resource ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc with Priority: HIGHEST for action security_group_members [ 669.813524] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc with Priority: HIGHEST for action security_group_members [ 669.813834] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.814139] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.814346] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.814534] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.814732] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.815041] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.815146] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.815351] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.815471] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.815669] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba6f8661-b38c-4d97-a1c5-4a0e33e341bc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.859040] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7e55e718-332b-4e94-bcb3-aba20ebe9549 [ 669.859040] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.859040] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.859040] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.859040] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.859040] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.859040] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7e55e718-332b-4e94-bcb3-aba20ebe9549 already deleted. [ 669.859040] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e55e718-332b-4e94-bcb3-aba20ebe9549" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.047376] env[68328]: INFO networking_nsxv3.common.synchronization [None req-a50b45c8-2532-4593-af2c-da3a2b36d03e None None] Enqueued Resource ID: 8651d5f2-9f40-48df-8ea0-f82a2ab7245a with Priority: HIGHEST for action port [ 670.047832] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8651d5f2-9f40-48df-8ea0-f82a2ab7245a with Priority: HIGHEST for action port [ 670.048433] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-8651d5f2-9f40-48df-8ea0-f82a2ab7245a taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.048433] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8651d5f2-9f40-48df-8ea0-f82a2ab7245a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.048433] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8651d5f2-9f40-48df-8ea0-f82a2ab7245a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.048742] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8651d5f2-9f40-48df-8ea0-f82a2ab7245a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.048803] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8651d5f2-9f40-48df-8ea0-f82a2ab7245a',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.201638] env[68328]: INFO networking_nsxv3.common.synchronization [req-a6ae4987-30f2-42e5-9c8e-9590d85da5b0 req-e87045fc-0062-4043-b783-b6c4f8c8e929 tempest-ServerDiagnosticsTest-2048554781 tempest-ServerDiagnosticsTest-2048554781-project-member] Enqueued Resource ID: b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38 with Priority: HIGHEST for action security_group_members [ 670.204060] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38 with Priority: HIGHEST for action security_group_members [ 670.205173] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.206609] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.206876] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.207731] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.207731] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.208809] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.208809] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.208809] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.208809] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.208809] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.284747] env[68328]: INFO networking_nsxv3.common.synchronization [None req-c96aa36d-3fc8-4001-bb5f-6c4f07bc2108 None None] Enqueued Resource ID: a7555eef-44d3-4b80-bca7-189fd9d8652e with Priority: HIGHEST for action port [ 670.284992] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7555eef-44d3-4b80-bca7-189fd9d8652e with Priority: HIGHEST for action port [ 670.285913] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7555eef-44d3-4b80-bca7-189fd9d8652e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.285913] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7555eef-44d3-4b80-bca7-189fd9d8652e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.285913] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7555eef-44d3-4b80-bca7-189fd9d8652e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.286135] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7555eef-44d3-4b80-bca7-189fd9d8652e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.286824] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7555eef-44d3-4b80-bca7-189fd9d8652e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.318982] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.319681] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.320112] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.321781] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.321781] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.321781] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.321781] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.321781] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.321781] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.321781] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.321781] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc already deleted. [ 670.321781] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.489475] env[68328]: INFO networking_nsxv3.common.synchronization [None req-619b3521-36b2-4b7d-bce5-1ec287d2ee08 None None] Enqueued Resource ID: 89bab52e-9d4e-42a0-bc81-1618ddbf5a4a with Priority: HIGHEST for action port [ 670.489475] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89bab52e-9d4e-42a0-bc81-1618ddbf5a4a with Priority: HIGHEST for action port [ 670.494103] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-89bab52e-9d4e-42a0-bc81-1618ddbf5a4a taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.494103] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89bab52e-9d4e-42a0-bc81-1618ddbf5a4a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.494103] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89bab52e-9d4e-42a0-bc81-1618ddbf5a4a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.494103] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89bab52e-9d4e-42a0-bc81-1618ddbf5a4a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.494103] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89bab52e-9d4e-42a0-bc81-1618ddbf5a4a',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.553363] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8651d5f2-9f40-48df-8ea0-f82a2ab7245a [ 670.555690] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.555690] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.555690] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.555690] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.555690] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.555690] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8651d5f2-9f40-48df-8ea0-f82a2ab7245a already deleted. [ 670.555690] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8651d5f2-9f40-48df-8ea0-f82a2ab7245a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.711652] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.711850] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.711929] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.712303] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.712434] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.712674] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.712816] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.712888] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.713061] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.713158] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.713248] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38 already deleted. [ 670.713531] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.789422] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a7555eef-44d3-4b80-bca7-189fd9d8652e [ 670.790351] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.790688] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.790978] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.792051] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.792051] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.792051] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a7555eef-44d3-4b80-bca7-189fd9d8652e already deleted. [ 670.792051] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7555eef-44d3-4b80-bca7-189fd9d8652e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.969873] env[68328]: INFO networking_nsxv3.common.synchronization [req-aad58217-d1b2-4fe9-a948-c2c0fd48bde1 req-3bd09c5e-6e4d-4d88-b828-58565d0597fd tempest-SecurityGroupRulesTestJSON-182117541 tempest-SecurityGroupRulesTestJSON-182117541-project-member] Enqueued Resource ID: 2b9c892e-1dc9-4692-b073-922dbd6ab245 with Priority: HIGHEST for action security_group_rules [ 670.969989] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b9c892e-1dc9-4692-b073-922dbd6ab245 with Priority: HIGHEST for action security_group_rules [ 670.970973] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b9c892e-1dc9-4692-b073-922dbd6ab245 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.970973] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b9c892e-1dc9-4692-b073-922dbd6ab245" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.970973] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b9c892e-1dc9-4692-b073-922dbd6ab245" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.971266] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b9c892e-1dc9-4692-b073-922dbd6ab245" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.971305] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b9c892e-1dc9-4692-b073-922dbd6ab245',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.994392] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 89bab52e-9d4e-42a0-bc81-1618ddbf5a4a [ 670.994572] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.994698] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.994767] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.994971] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.995092] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.995192] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:89bab52e-9d4e-42a0-bc81-1618ddbf5a4a already deleted. [ 670.995275] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89bab52e-9d4e-42a0-bc81-1618ddbf5a4a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.497791] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.498279] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.498331] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.498643] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.498742] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.498842] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b9c892e-1dc9-4692-b073-922dbd6ab245 already deleted. [ 671.498930] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b9c892e-1dc9-4692-b073-922dbd6ab245" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.606270] env[68328]: INFO networking_nsxv3.common.synchronization [req-9f7d3cc7-a77a-4cef-afdc-1af20d8a12a4 req-4ecad5d3-3d37-40dc-a909-f20f30fc6c0b tempest-TenantUsagesTestJSON-563650200 tempest-TenantUsagesTestJSON-563650200-project-member] Enqueued Resource ID: 72ca69cd-fcd9-4815-b331-9858d9cfad42 with Priority: HIGHEST for action security_group_members [ 671.606801] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72ca69cd-fcd9-4815-b331-9858d9cfad42 with Priority: HIGHEST for action security_group_members [ 671.607137] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-72ca69cd-fcd9-4815-b331-9858d9cfad42 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.607309] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72ca69cd-fcd9-4815-b331-9858d9cfad42" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.607309] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72ca69cd-fcd9-4815-b331-9858d9cfad42" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.607556] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72ca69cd-fcd9-4815-b331-9858d9cfad42" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.611960] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.612200] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.612200] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.612339] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.612520] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.612520] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72ca69cd-fcd9-4815-b331-9858d9cfad42',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.765434] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed in Status: SUCCESS [ 671.765891] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.766488] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.766894] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.767017] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.116551] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.116710] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.116795] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.117015] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.117134] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.117332] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.117431] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.117491] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.117665] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.117743] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.117827] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72ca69cd-fcd9-4815-b331-9858d9cfad42 already deleted. [ 672.117904] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72ca69cd-fcd9-4815-b331-9858d9cfad42" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.210063] env[68328]: INFO networking_nsxv3.common.synchronization [req-b6093b30-4651-41e7-9f36-a49a960b50d8 req-c31e2533-a8b0-4a74-b915-abe7b42ded8d tempest-ServersTestMultiNic-360170984 tempest-ServersTestMultiNic-360170984-project-member] Enqueued Resource ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc with Priority: HIGHEST for action security_group_members [ 672.210606] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc with Priority: HIGHEST for action security_group_members [ 672.211211] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.211211] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.211358] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.211558] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.211757] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.211805] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.211869] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.212253] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.212253] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.212253] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba6f8661-b38c-4d97-a1c5-4a0e33e341bc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.269384] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.269535] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.269606] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.269966] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.270164] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.270274] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.270339] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.270509] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.270596] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.270683] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.270769] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.302838] env[68328]: INFO networking_nsxv3.common.synchronization [req-8ed05c1e-c070-46b0-80a7-f18043afbbd5 req-c1ea25b8-a3ac-4fb1-b302-452b8f5f54ca tempest-SecurityGroupRulesNegativeTestJSON-1570722059 tempest-SecurityGroupRulesNegativeTestJSON-1570722059-project-member] Enqueued Resource ID: 13b9e468-1742-4ecd-a19c-a16df2668997 with Priority: HIGHEST for action security_group_rules [ 672.303401] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13b9e468-1742-4ecd-a19c-a16df2668997 with Priority: HIGHEST for action security_group_rules [ 672.304429] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-13b9e468-1742-4ecd-a19c-a16df2668997 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.304624] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-13b9e468-1742-4ecd-a19c-a16df2668997" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.304737] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-13b9e468-1742-4ecd-a19c-a16df2668997" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.305503] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-13b9e468-1742-4ecd-a19c-a16df2668997" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.305640] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('13b9e468-1742-4ecd-a19c-a16df2668997',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.646154] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-739 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.646527] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-739" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.646649] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-739" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.646974] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-739" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.647496] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.647585] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.647774] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.648129] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.648362] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.650855] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 672.650855] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 672.650855] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 672.650855] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 672.650855] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 672.650855] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 672.650855] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 672.670788] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 672.670971] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 672.671248] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 672.671471] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-739" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.671645] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-b3224f5d-6b84-4dc7-ab99-2d194d7a72a4 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.671813] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-b3224f5d-6b84-4dc7-ab99-2d194d7a72a4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.671926] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-b3224f5d-6b84-4dc7-ab99-2d194d7a72a4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.672303] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-b3224f5d-6b84-4dc7-ab99-2d194d7a72a4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.672439] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3224f5d-6b84-4dc7-ab99-2d194d7a72a4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.716059] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.716059] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.716059] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.716059] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.716059] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.716059] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.716059] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.716059] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.716059] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.716059] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.716059] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc already deleted. [ 672.716059] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.775093] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.775294] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.775515] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.775876] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.776176] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.776371] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.776473] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.776723] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.776824] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.776944] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.779348] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.779348] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.779348] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.779348] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.779348] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.779348] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.779348] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.779348] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.780347] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.780593] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.780593] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.828251] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.828251] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.828251] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.828251] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.828251] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.828251] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 13b9e468-1742-4ecd-a19c-a16df2668997 already deleted. [ 672.828251] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-13b9e468-1742-4ecd-a19c-a16df2668997" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.032708] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-739 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.032849] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-739" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.032888] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-739" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.033281] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-739" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.033640] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.033853] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.037375] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.037861] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.038126] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.038729] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 673.038729] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 673.038867] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 673.038908] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 673.039085] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 673.039247] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 673.039552] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 673.077131] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 673.077131] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 673.077131] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 673.077131] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-739" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.077131] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-4683586a-20f4-43c1-b2a1-d2c5d45ac15d taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.077131] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-4683586a-20f4-43c1-b2a1-d2c5d45ac15d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.077131] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-4683586a-20f4-43c1-b2a1-d2c5d45ac15d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.077131] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-4683586a-20f4-43c1-b2a1-d2c5d45ac15d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.077131] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4683586a-20f4-43c1-b2a1-d2c5d45ac15d',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.177390] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.177733] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.177886] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.178196] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.178345] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.178499] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port b3224f5d-6b84-4dc7-ab99-2d194d7a72a4 not found, creating... [ 673.178797] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.179082] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.179082] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.179315] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.179451] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.179761] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.179928] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.180650] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.180912] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.181077] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.181228] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: b3224f5d-6b84-4dc7-ab99-2d194d7a72a4 is going to be created. [ 673.204842] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.205119] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.205269] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.205606] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.205703] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.205916] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-b3224f5d-6b84-4dc7-ab99-2d194d7a72a4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.284088] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed: rpc.has_security_group_logging(os_id): False [ 673.301998] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.302853] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.303220] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.305167] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.305643] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.305943] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.306104] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.306193] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.310020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.310020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.310020] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.310020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.310020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.310020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.310020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.310020] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.310020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.310020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.310020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.310020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.310020] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed is going to be updated. [ 673.379245] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.379496] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.379586] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.381037] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.381037] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.397630] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed in Status: IN_PROGRESS for 2s [ 673.581251] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.581251] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.581251] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.582268] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.582268] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.582268] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 4683586a-20f4-43c1-b2a1-d2c5d45ac15d not found, creating... [ 673.582753] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.582753] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.582902] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.585851] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.585851] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.585851] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.585851] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.585851] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.585851] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.585851] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.585851] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 4683586a-20f4-43c1-b2a1-d2c5d45ac15d is going to be created. [ 673.605135] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.605135] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.605135] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.605135] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.605428] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.605428] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-4683586a-20f4-43c1-b2a1-d2c5d45ac15d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.034728] env[68328]: INFO networking_nsxv3.common.synchronization [None req-e59d3003-3dec-4c83-be4c-0fc1f3bfc192 None None] Enqueued Resource ID: f2395f79-dd67-4c7e-8fa6-ce8d6819e626 with Priority: HIGHEST for action port [ 674.034996] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2395f79-dd67-4c7e-8fa6-ce8d6819e626 with Priority: HIGHEST for action port [ 674.035569] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2395f79-dd67-4c7e-8fa6-ce8d6819e626 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.035688] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2395f79-dd67-4c7e-8fa6-ce8d6819e626" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.035745] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2395f79-dd67-4c7e-8fa6-ce8d6819e626" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.036000] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2395f79-dd67-4c7e-8fa6-ce8d6819e626" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.036545] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2395f79-dd67-4c7e-8fa6-ce8d6819e626',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.140080] env[68328]: INFO networking_nsxv3.common.synchronization [None req-d7f77f39-e78e-4652-be6f-13b83d581f54 None None] Enqueued Resource ID: 2895bcf5-41e7-446d-b971-d4f47be1f378 with Priority: HIGHEST for action port [ 674.140527] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2895bcf5-41e7-446d-b971-d4f47be1f378 with Priority: HIGHEST for action port [ 674.143191] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-2895bcf5-41e7-446d-b971-d4f47be1f378 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.143611] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2895bcf5-41e7-446d-b971-d4f47be1f378" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.143611] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2895bcf5-41e7-446d-b971-d4f47be1f378" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.143935] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2895bcf5-41e7-446d-b971-d4f47be1f378" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.143935] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2895bcf5-41e7-446d-b971-d4f47be1f378',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.251828] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-340 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.252081] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-340" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.252242] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-340" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.252593] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-340" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.252853] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.253036] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.253286] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.253438] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.254204] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.254407] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 674.254530] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 674.254637] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 674.254749] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 674.254858] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 674.254965] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 674.255110] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 674.282196] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 674.282438] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 674.282515] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 674.282702] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-340" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.283557] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-306781a4-1e3e-47f9-b07e-cd5abb05096d taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.283557] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-306781a4-1e3e-47f9-b07e-cd5abb05096d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.283557] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-306781a4-1e3e-47f9-b07e-cd5abb05096d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.283860] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-306781a4-1e3e-47f9-b07e-cd5abb05096d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.283860] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('306781a4-1e3e-47f9-b07e-cd5abb05096d',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.488359] env[68328]: INFO networking_nsxv3.common.synchronization [None req-2315c411-c184-4922-a444-0a17f5753703 None None] Enqueued Resource ID: 5f492dbf-a433-4173-8eca-c71082ac441c with Priority: HIGHEST for action port [ 674.489496] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f492dbf-a433-4173-8eca-c71082ac441c with Priority: HIGHEST for action port [ 674.489496] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f492dbf-a433-4173-8eca-c71082ac441c taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.489496] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f492dbf-a433-4173-8eca-c71082ac441c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.489496] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f492dbf-a433-4173-8eca-c71082ac441c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.489718] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f492dbf-a433-4173-8eca-c71082ac441c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.489755] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f492dbf-a433-4173-8eca-c71082ac441c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.496419] env[68328]: INFO networking_nsxv3.common.synchronization [None req-5a295337-78c2-4fb9-b0f3-63139343153c None None] Enqueued Resource ID: 2b1cb502-8367-40eb-9de3-740e23692a29 with Priority: HIGHEST for action port [ 674.496419] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b1cb502-8367-40eb-9de3-740e23692a29 with Priority: HIGHEST for action port [ 674.496871] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b1cb502-8367-40eb-9de3-740e23692a29 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.497034] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b1cb502-8367-40eb-9de3-740e23692a29" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.497122] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b1cb502-8367-40eb-9de3-740e23692a29" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.498397] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b1cb502-8367-40eb-9de3-740e23692a29" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.498397] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b1cb502-8367-40eb-9de3-740e23692a29',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.539871] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f2395f79-dd67-4c7e-8fa6-ce8d6819e626 [ 674.541575] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.541575] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.541575] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.541575] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.541575] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.541575] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f2395f79-dd67-4c7e-8fa6-ce8d6819e626 already deleted. [ 674.541575] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2395f79-dd67-4c7e-8fa6-ce8d6819e626" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.649510] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2895bcf5-41e7-446d-b971-d4f47be1f378 [ 674.651678] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.651678] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.651678] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.651678] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.651678] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.651678] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2895bcf5-41e7-446d-b971-d4f47be1f378 already deleted. [ 674.651678] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2895bcf5-41e7-446d-b971-d4f47be1f378" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.695432] env[68328]: INFO networking_nsxv3.common.synchronization [req-9f7d3cc7-a77a-4cef-afdc-1af20d8a12a4 req-7297ddc7-d089-4b3c-937e-d1c331f8705b service nova] Enqueued Resource ID: 72ca69cd-fcd9-4815-b331-9858d9cfad42 with Priority: HIGHEST for action security_group_rules [ 674.696086] env[68328]: INFO networking_nsxv3.common.synchronization [req-9f7d3cc7-a77a-4cef-afdc-1af20d8a12a4 req-7297ddc7-d089-4b3c-937e-d1c331f8705b service nova] Enqueued Resource ID: 72ca69cd-fcd9-4815-b331-9858d9cfad42 with Priority: HIGHEST for action security_group_members [ 674.696289] env[68328]: INFO networking_nsxv3.common.synchronization [req-9f7d3cc7-a77a-4cef-afdc-1af20d8a12a4 req-7297ddc7-d089-4b3c-937e-d1c331f8705b service nova] Enqueued Resource ID: 4683586a-20f4-43c1-b2a1-d2c5d45ac15d with Priority: HIGHEST for action port [ 674.697046] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72ca69cd-fcd9-4815-b331-9858d9cfad42 with Priority: HIGHEST for action security_group_rules [ 674.697805] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72ca69cd-fcd9-4815-b331-9858d9cfad42 with Priority: HIGHEST for action security_group_members [ 674.697953] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4683586a-20f4-43c1-b2a1-d2c5d45ac15d with Priority: HIGHEST for action port [ 674.698284] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72ca69cd-fcd9-4815-b331-9858d9cfad42 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.698604] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72ca69cd-fcd9-4815-b331-9858d9cfad42" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.698604] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72ca69cd-fcd9-4815-b331-9858d9cfad42" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.698751] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72ca69cd-fcd9-4815-b331-9858d9cfad42" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.698850] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72ca69cd-fcd9-4815-b331-9858d9cfad42',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.702764] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-72ca69cd-fcd9-4815-b331-9858d9cfad42 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.702896] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72ca69cd-fcd9-4815-b331-9858d9cfad42" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.703436] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72ca69cd-fcd9-4815-b331-9858d9cfad42" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.703436] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72ca69cd-fcd9-4815-b331-9858d9cfad42" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.703523] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.703613] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.703674] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.703918] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.704649] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.704649] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72ca69cd-fcd9-4815-b331-9858d9cfad42',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.705064] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-4683586a-20f4-43c1-b2a1-d2c5d45ac15d taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.705163] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4683586a-20f4-43c1-b2a1-d2c5d45ac15d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.705226] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4683586a-20f4-43c1-b2a1-d2c5d45ac15d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.705395] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4683586a-20f4-43c1-b2a1-d2c5d45ac15d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.705507] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4683586a-20f4-43c1-b2a1-d2c5d45ac15d',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.791226] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.791226] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.791226] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.791512] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.791749] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.791934] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 306781a4-1e3e-47f9-b07e-cd5abb05096d not found, creating... [ 674.792229] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.792399] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.792515] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.792752] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.792887] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.793191] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.793348] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.793462] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.794693] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.794693] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.794693] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 306781a4-1e3e-47f9-b07e-cd5abb05096d is going to be created. [ 674.819516] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.821133] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.821838] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.822848] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.823688] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.824613] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-306781a4-1e3e-47f9-b07e-cd5abb05096d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.994088] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5f492dbf-a433-4173-8eca-c71082ac441c [ 674.994435] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.994763] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.994763] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.994978] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.997133] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.997133] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5f492dbf-a433-4173-8eca-c71082ac441c already deleted. [ 674.997133] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f492dbf-a433-4173-8eca-c71082ac441c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.002375] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2b1cb502-8367-40eb-9de3-740e23692a29 [ 675.002375] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.002375] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.002375] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.002375] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.002375] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.003264] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2b1cb502-8367-40eb-9de3-740e23692a29 already deleted. [ 675.003264] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b1cb502-8367-40eb-9de3-740e23692a29" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.203514] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-72ca69cd-fcd9-4815-b331-9858d9cfad42 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.203861] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72ca69cd-fcd9-4815-b331-9858d9cfad42" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.209459] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4683586a-20f4-43c1-b2a1-d2c5d45ac15d with status ACTIVE [ 675.209459] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.209739] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.209739] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.210241] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.210241] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.210241] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.210427] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.210427] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.211332] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.211332] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.211332] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.211332] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.211332] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.211332] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.211332] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.211332] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4683586a-20f4-43c1-b2a1-d2c5d45ac15d is going to be updated. [ 675.212446] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('72ca69cd-fcd9-4815-b331-9858d9cfad42',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.237428] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.237634] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.237743] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.238568] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.240708] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.240708] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4683586a-20f4-43c1-b2a1-d2c5d45ac15d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.261966] env[68328]: INFO networking_nsxv3.common.synchronization [None req-52b49f5c-4e46-4b97-a550-7f893208f533 tempest-ServersTestManualDisk-40743403 tempest-ServersTestManualDisk-40743403-project-member] Enqueued Resource ID: 3826a056-9a94-48ea-97d8-49b840d3fb63 with Priority: HIGHEST for action security_group_rules [ 675.262638] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3826a056-9a94-48ea-97d8-49b840d3fb63 with Priority: HIGHEST for action security_group_rules [ 675.263033] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3826a056-9a94-48ea-97d8-49b840d3fb63 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.263212] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3826a056-9a94-48ea-97d8-49b840d3fb63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.263299] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3826a056-9a94-48ea-97d8-49b840d3fb63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.263578] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3826a056-9a94-48ea-97d8-49b840d3fb63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.263685] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3826a056-9a94-48ea-97d8-49b840d3fb63',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.383324] env[68328]: INFO networking_nsxv3.common.synchronization [None req-30bedf18-db02-4f06-b8c6-986c1cdc74a6 None None] Enqueued Resource ID: a77f635d-96b4-4fc8-96c4-663d3997e39f with Priority: HIGHEST for action port [ 675.383903] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a77f635d-96b4-4fc8-96c4-663d3997e39f with Priority: HIGHEST for action port [ 675.384523] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-a77f635d-96b4-4fc8-96c4-663d3997e39f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.384728] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a77f635d-96b4-4fc8-96c4-663d3997e39f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.384802] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a77f635d-96b4-4fc8-96c4-663d3997e39f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.385138] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a77f635d-96b4-4fc8-96c4-663d3997e39f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.385252] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a77f635d-96b4-4fc8-96c4-663d3997e39f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.413585] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed in Status: SUCCESS [ 675.413761] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.717522] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('72ca69cd-fcd9-4815-b331-9858d9cfad42',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.789906] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.789906] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.789906] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.789906] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.789906] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.789906] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3826a056-9a94-48ea-97d8-49b840d3fb63 already deleted. [ 675.789906] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3826a056-9a94-48ea-97d8-49b840d3fb63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.791966] env[68328]: INFO networking_nsxv3.common.synchronization [req-a6ae4987-30f2-42e5-9c8e-9590d85da5b0 req-01e00d5f-e4d2-4948-bfef-319e900d03f4 service nova] Enqueued Resource ID: b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38 with Priority: HIGHEST for action security_group_rules [ 675.792236] env[68328]: INFO networking_nsxv3.common.synchronization [req-a6ae4987-30f2-42e5-9c8e-9590d85da5b0 req-01e00d5f-e4d2-4948-bfef-319e900d03f4 service nova] Enqueued Resource ID: b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38 with Priority: HIGHEST for action security_group_members [ 675.792441] env[68328]: INFO networking_nsxv3.common.synchronization [req-a6ae4987-30f2-42e5-9c8e-9590d85da5b0 req-01e00d5f-e4d2-4948-bfef-319e900d03f4 service nova] Enqueued Resource ID: b3224f5d-6b84-4dc7-ab99-2d194d7a72a4 with Priority: HIGHEST for action port [ 675.796029] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38 with Priority: HIGHEST for action security_group_rules [ 675.796029] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38 with Priority: HIGHEST for action security_group_members [ 675.796029] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3224f5d-6b84-4dc7-ab99-2d194d7a72a4 with Priority: HIGHEST for action port [ 675.796029] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.796029] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.796029] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.796029] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.796029] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.797039] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.797234] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.797357] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.797628] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.797854] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.798023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.798132] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.798402] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.798714] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.798895] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.801132] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3224f5d-6b84-4dc7-ab99-2d194d7a72a4 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.802134] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3224f5d-6b84-4dc7-ab99-2d194d7a72a4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.802134] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3224f5d-6b84-4dc7-ab99-2d194d7a72a4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.802134] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3224f5d-6b84-4dc7-ab99-2d194d7a72a4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.802134] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3224f5d-6b84-4dc7-ab99-2d194d7a72a4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.888409] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a77f635d-96b4-4fc8-96c4-663d3997e39f [ 675.889395] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.889395] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.889395] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.889395] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.889395] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.889395] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a77f635d-96b4-4fc8-96c4-663d3997e39f already deleted. [ 675.889395] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a77f635d-96b4-4fc8-96c4-663d3997e39f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.006548] env[68328]: INFO networking_nsxv3.common.synchronization [None req-737c038a-7eba-49ab-b09b-b52c491824ee tempest-ServersTestManualDisk-40743403 tempest-ServersTestManualDisk-40743403-project-member] Enqueued Resource ID: 3826a056-9a94-48ea-97d8-49b840d3fb63 with Priority: HIGHEST for action security_group_rules [ 676.007194] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3826a056-9a94-48ea-97d8-49b840d3fb63 with Priority: HIGHEST for action security_group_rules [ 676.007541] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3826a056-9a94-48ea-97d8-49b840d3fb63 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.007678] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3826a056-9a94-48ea-97d8-49b840d3fb63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.007751] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3826a056-9a94-48ea-97d8-49b840d3fb63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.008028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3826a056-9a94-48ea-97d8-49b840d3fb63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.008121] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3826a056-9a94-48ea-97d8-49b840d3fb63',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.144364] env[68328]: INFO networking_nsxv3.common.synchronization [None req-8e2ea4ed-26e1-42a5-8610-590f9ded0868 None None] Enqueued Resource ID: 5df6e3d4-e6e8-4fcd-83ab-1779a3054b44 with Priority: HIGHEST for action port [ 676.144635] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5df6e3d4-e6e8-4fcd-83ab-1779a3054b44 with Priority: HIGHEST for action port [ 676.145605] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-5df6e3d4-e6e8-4fcd-83ab-1779a3054b44 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.145748] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5df6e3d4-e6e8-4fcd-83ab-1779a3054b44" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.145807] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5df6e3d4-e6e8-4fcd-83ab-1779a3054b44" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.147177] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5df6e3d4-e6e8-4fcd-83ab-1779a3054b44" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.147306] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5df6e3d4-e6e8-4fcd-83ab-1779a3054b44',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.220687] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.221624] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.221624] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.221624] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.221624] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.221624] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72ca69cd-fcd9-4815-b331-9858d9cfad42 is going to be created. [ 676.248851] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.249220] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.249220] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.249414] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.249601] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.258348] env[68328]: INFO networking_nsxv3.common.synchronization [req-a0c0106b-c12f-4369-9a16-51f1929d5d4a req-f5b9999c-26a8-4712-a504-5a94a2a04377 tempest-ServerExternalEventsTest-773432568 tempest-ServerExternalEventsTest-773432568-project-member] Enqueued Resource ID: 8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b with Priority: HIGHEST for action security_group_members [ 676.258633] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b with Priority: HIGHEST for action security_group_members [ 676.259293] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.259416] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.259479] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.259735] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.259908] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.260014] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.262869] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.263132] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.263279] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.263368] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.264900] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72ca69cd-fcd9-4815-b331-9858d9cfad42 in Status: UNINITIALIZED for 2s [ 676.303109] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.303476] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.304365] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.308298] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b3224f5d-6b84-4dc7-ab99-2d194d7a72a4 with status ACTIVE [ 676.308298] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.308298] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.308298] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.308298] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.308298] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.308298] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.308298] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.308298] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.309528] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.309528] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.309528] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.309528] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.309528] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.309978] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.309978] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.309978] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b3224f5d-6b84-4dc7-ab99-2d194d7a72a4 is going to be updated. [ 676.332023] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.332205] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.332275] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.332492] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.332618] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.332795] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3224f5d-6b84-4dc7-ab99-2d194d7a72a4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.533067] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.533067] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.533621] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.533621] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.533621] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.533762] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3826a056-9a94-48ea-97d8-49b840d3fb63 already deleted. [ 676.533898] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3826a056-9a94-48ea-97d8-49b840d3fb63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.653519] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5df6e3d4-e6e8-4fcd-83ab-1779a3054b44 [ 676.654588] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.657390] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.657479] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.657708] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.657818] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.657918] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5df6e3d4-e6e8-4fcd-83ab-1779a3054b44 already deleted. [ 676.657998] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5df6e3d4-e6e8-4fcd-83ab-1779a3054b44" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.769576] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.769576] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.769576] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.769576] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.769576] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.769576] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.769576] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.769576] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.769576] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.769576] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.769576] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b already deleted. [ 676.769576] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.814514] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.937163] env[68328]: INFO networking_nsxv3.common.synchronization [None req-1c1433a6-3313-4c07-94bb-efc7accf51db None None] Enqueued Resource ID: 4b8e5069-e2bc-4ded-b94e-73a94c79dfb0 with Priority: HIGHEST for action port [ 676.941079] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b8e5069-e2bc-4ded-b94e-73a94c79dfb0 with Priority: HIGHEST for action port [ 676.941079] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b8e5069-e2bc-4ded-b94e-73a94c79dfb0 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.941079] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b8e5069-e2bc-4ded-b94e-73a94c79dfb0" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.941079] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b8e5069-e2bc-4ded-b94e-73a94c79dfb0" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.941079] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b8e5069-e2bc-4ded-b94e-73a94c79dfb0" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.941079] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b8e5069-e2bc-4ded-b94e-73a94c79dfb0',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.027032] env[68328]: INFO networking_nsxv3.common.synchronization [None req-2d7195a8-bf9a-4505-8385-280e51e52e45 tempest-VolumesAdminNegativeTest-207194333 tempest-VolumesAdminNegativeTest-207194333-project-member] Enqueued Resource ID: b3fc1540-17fb-42c4-99d2-880ae35db079 with Priority: HIGHEST for action security_group_rules [ 677.027032] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3fc1540-17fb-42c4-99d2-880ae35db079 with Priority: HIGHEST for action security_group_rules [ 677.027032] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b3fc1540-17fb-42c4-99d2-880ae35db079 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.027032] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b3fc1540-17fb-42c4-99d2-880ae35db079" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.027597] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b3fc1540-17fb-42c4-99d2-880ae35db079" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.027597] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b3fc1540-17fb-42c4-99d2-880ae35db079" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.027669] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b3fc1540-17fb-42c4-99d2-880ae35db079',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.032380] env[68328]: INFO networking_nsxv3.common.synchronization [None req-078eb75c-cb3f-4853-9071-870aa3adbadc None None] Enqueued Resource ID: a275c26b-35fd-4a51-9bb1-f7bbab6a0a8b with Priority: HIGHEST for action port [ 677.032850] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a275c26b-35fd-4a51-9bb1-f7bbab6a0a8b with Priority: HIGHEST for action port [ 677.033852] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-a275c26b-35fd-4a51-9bb1-f7bbab6a0a8b taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.034014] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a275c26b-35fd-4a51-9bb1-f7bbab6a0a8b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.034321] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a275c26b-35fd-4a51-9bb1-f7bbab6a0a8b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.034703] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a275c26b-35fd-4a51-9bb1-f7bbab6a0a8b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.036651] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a275c26b-35fd-4a51-9bb1-f7bbab6a0a8b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.251699] env[68328]: INFO networking_nsxv3.common.synchronization [req-b6093b30-4651-41e7-9f36-a49a960b50d8 req-9be6300c-f3d4-4dbd-b954-b615a0c3fd8b service nova] Enqueued Resource ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc with Priority: HIGHEST for action security_group_rules [ 677.252032] env[68328]: INFO networking_nsxv3.common.synchronization [req-b6093b30-4651-41e7-9f36-a49a960b50d8 req-9be6300c-f3d4-4dbd-b954-b615a0c3fd8b service nova] Enqueued Resource ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc with Priority: HIGHEST for action security_group_members [ 677.252032] env[68328]: INFO networking_nsxv3.common.synchronization [req-b6093b30-4651-41e7-9f36-a49a960b50d8 req-9be6300c-f3d4-4dbd-b954-b615a0c3fd8b service nova] Enqueued Resource ID: 306781a4-1e3e-47f9-b07e-cd5abb05096d with Priority: HIGHEST for action port [ 677.252551] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc with Priority: HIGHEST for action security_group_rules [ 677.252754] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc with Priority: HIGHEST for action security_group_members [ 677.252843] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 306781a4-1e3e-47f9-b07e-cd5abb05096d with Priority: HIGHEST for action port [ 677.253048] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.253175] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.253239] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.253485] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.253566] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba6f8661-b38c-4d97-a1c5-4a0e33e341bc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.254838] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.257828] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.257828] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.257828] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.257828] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.257828] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.257828] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.257828] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.257828] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.257828] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba6f8661-b38c-4d97-a1c5-4a0e33e341bc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.257828] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-306781a4-1e3e-47f9-b07e-cd5abb05096d taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.257828] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-306781a4-1e3e-47f9-b07e-cd5abb05096d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.257828] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-306781a4-1e3e-47f9-b07e-cd5abb05096d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.257828] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-306781a4-1e3e-47f9-b07e-cd5abb05096d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.257828] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('306781a4-1e3e-47f9-b07e-cd5abb05096d',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.319032] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.319032] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.319032] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.319032] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.319032] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.319032] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38 is going to be created. [ 677.346093] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.346093] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.346093] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.346093] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.346093] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.359134] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38 in Status: UNINITIALIZED for 2s [ 677.443765] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4b8e5069-e2bc-4ded-b94e-73a94c79dfb0 [ 677.444500] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.444710] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.445434] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.445434] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.445434] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.445592] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4b8e5069-e2bc-4ded-b94e-73a94c79dfb0 already deleted. [ 677.445631] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b8e5069-e2bc-4ded-b94e-73a94c79dfb0" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.484798] env[68328]: INFO networking_nsxv3.common.synchronization [None req-2072e2e0-e7d3-4d2d-97bc-66a8610c7878 tempest-VolumesAdminNegativeTest-207194333 tempest-VolumesAdminNegativeTest-207194333-project-member] Enqueued Resource ID: b3fc1540-17fb-42c4-99d2-880ae35db079 with Priority: HIGHEST for action security_group_rules [ 677.485886] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3fc1540-17fb-42c4-99d2-880ae35db079 with Priority: HIGHEST for action security_group_rules [ 677.486460] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b3fc1540-17fb-42c4-99d2-880ae35db079 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.486582] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b3fc1540-17fb-42c4-99d2-880ae35db079" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.539373] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a275c26b-35fd-4a51-9bb1-f7bbab6a0a8b [ 677.539590] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.539810] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.539895] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.540131] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.540229] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.540326] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a275c26b-35fd-4a51-9bb1-f7bbab6a0a8b already deleted. [ 677.540408] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a275c26b-35fd-4a51-9bb1-f7bbab6a0a8b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.546871] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.547045] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.547115] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.547321] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.547410] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.547519] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b3fc1540-17fb-42c4-99d2-880ae35db079 already deleted. [ 677.547611] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b3fc1540-17fb-42c4-99d2-880ae35db079" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.547750] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b3fc1540-17fb-42c4-99d2-880ae35db079" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.547903] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b3fc1540-17fb-42c4-99d2-880ae35db079" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.547984] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b3fc1540-17fb-42c4-99d2-880ae35db079',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.759076] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.759076] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.763985] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 306781a4-1e3e-47f9-b07e-cd5abb05096d with status ACTIVE [ 677.763985] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.763985] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.763985] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.763985] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.763985] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.763985] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.763985] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.763985] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.763985] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.763985] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.763985] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.763985] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.763985] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.763985] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.763985] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.763985] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 306781a4-1e3e-47f9-b07e-cd5abb05096d is going to be updated. [ 677.764704] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ba6f8661-b38c-4d97-a1c5-4a0e33e341bc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.787699] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.787914] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.788046] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.789051] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.789051] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.789051] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-306781a4-1e3e-47f9-b07e-cd5abb05096d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.944641] env[68328]: INFO networking_nsxv3.common.synchronization [req-9a96dfdd-e3a9-46a8-b906-053a5bb8db65 req-2c84c8cd-6e59-4368-ab32-87fbac9dd9ed tempest-DeleteServersAdminTestJSON-1284607140 tempest-DeleteServersAdminTestJSON-1284607140-project-admin] Enqueued Resource ID: f302de28-ce4b-4460-9ba9-d832cf4c957e with Priority: HIGHEST for action security_group_members [ 677.944916] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f302de28-ce4b-4460-9ba9-d832cf4c957e with Priority: HIGHEST for action security_group_members [ 677.945480] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-f302de28-ce4b-4460-9ba9-d832cf4c957e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.945608] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.945679] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.946012] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.946434] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.946548] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.946615] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.946782] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.946868] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.946966] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f302de28-ce4b-4460-9ba9-d832cf4c957e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.069481] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.069712] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.069712] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.069860] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.069947] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.070360] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b3fc1540-17fb-42c4-99d2-880ae35db079 already deleted. [ 678.070360] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b3fc1540-17fb-42c4-99d2-880ae35db079" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.196767] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-739 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.196956] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-739" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.197089] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-739" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.197353] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-739" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.197603] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.197749] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.197863] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.198579] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.198909] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.199134] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 678.199248] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 678.199355] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 678.199462] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 678.199569] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 678.199776] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 678.199837] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 678.248200] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 678.249086] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.049 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 678.249428] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 678.249723] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-739" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.251033] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-7f42f847-a378-41d1-99b2-2e4565065b5f taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.251033] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-7f42f847-a378-41d1-99b2-2e4565065b5f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.251033] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-7f42f847-a378-41d1-99b2-2e4565065b5f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.251033] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-7f42f847-a378-41d1-99b2-2e4565065b5f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.252193] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f42f847-a378-41d1-99b2-2e4565065b5f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.269698] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ba6f8661-b38c-4d97-a1c5-4a0e33e341bc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.278508] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72ca69cd-fcd9-4815-b331-9858d9cfad42 in Status: SUCCESS [ 678.278761] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72ca69cd-fcd9-4815-b331-9858d9cfad42" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.278925] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72ca69cd-fcd9-4815-b331-9858d9cfad42" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.279157] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72ca69cd-fcd9-4815-b331-9858d9cfad42" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.279345] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.279457] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.279518] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.279679] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.279764] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.279845] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72ca69cd-fcd9-4815-b331-9858d9cfad42" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.279931] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('72ca69cd-fcd9-4815-b331-9858d9cfad42',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.306259] env[68328]: INFO networking_nsxv3.common.synchronization [req-a4581a1b-a1d4-46b6-845a-c8f8b7c1385f req-efa0b88f-0007-4347-bb25-80761da624a5 tempest-MigrationsAdminTest-1924704487 tempest-MigrationsAdminTest-1924704487-project-member] Enqueued Resource ID: ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 with Priority: HIGHEST for action security_group_members [ 678.306752] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 with Priority: HIGHEST for action security_group_members [ 678.307073] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.307197] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.307263] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.307520] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.307682] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.307784] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.307900] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.307989] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.308236] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.308335] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ccbebeb4-60d7-4344-b96e-b9dfdeae14b1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.448911] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.449167] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.449242] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.449467] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.449554] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.449769] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.449866] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.449919] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.450092] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.450165] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.450248] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f302de28-ce4b-4460-9ba9-d832cf4c957e is going to be updated. [ 678.491792] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.492049] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.492049] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.492260] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.492519] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.504769] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f302de28-ce4b-4460-9ba9-d832cf4c957e in Status: IN_PROGRESS for 2s [ 678.754285] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.754552] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.754707] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.755060] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.755250] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.755438] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 7f42f847-a378-41d1-99b2-2e4565065b5f not found, creating... [ 678.755761] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.755949] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.757210] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.757210] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.757210] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.757210] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.757210] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.757210] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.757637] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.757637] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.757637] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 7f42f847-a378-41d1-99b2-2e4565065b5f is going to be created. [ 678.776022] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.776022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.776022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.776022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.776022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.776022] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc is going to be created. [ 678.779519] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.780453] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.780657] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.780989] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.781280] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.781529] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-7f42f847-a378-41d1-99b2-2e4565065b5f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.785854] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-72ca69cd-fcd9-4815-b331-9858d9cfad42 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.785989] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72ca69cd-fcd9-4815-b331-9858d9cfad42" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.786066] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72ca69cd-fcd9-4815-b331-9858d9cfad42" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.786268] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72ca69cd-fcd9-4815-b331-9858d9cfad42" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.786427] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.786524] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.786581] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.786747] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.786830] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.786913] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72ca69cd-fcd9-4815-b331-9858d9cfad42" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.787067] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-72ca69cd-fcd9-4815-b331-9858d9cfad42 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.787154] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72ca69cd-fcd9-4815-b331-9858d9cfad42" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.787233] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72ca69cd-fcd9-4815-b331-9858d9cfad42" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.787396] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72ca69cd-fcd9-4815-b331-9858d9cfad42" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.787548] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.787620] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.787677] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.787809] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.787877] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.787951] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72ca69cd-fcd9-4815-b331-9858d9cfad42" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.788041] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('72ca69cd-fcd9-4815-b331-9858d9cfad42',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.811414] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.811573] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.811611] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.811827] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.811974] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.813744] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.813861] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.813906] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.814447] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.814535] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.814719] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.814814] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.814876] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.815039] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.815113] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.815195] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 already deleted. [ 678.817512] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.827925] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc in Status: UNINITIALIZED for 2s [ 678.946023] env[68328]: INFO networking_nsxv3.common.synchronization [req-0cb442f8-d401-4be7-a1ff-0434046b9b33 req-b8be1e6e-7ea6-42dc-b958-d7f3f3c411da tempest-SecurityGroupRulesTestJSON-182117541 tempest-SecurityGroupRulesTestJSON-182117541-project-member] Enqueued Resource ID: 99f9ac57-22d2-4cc7-b5b2-bd92942667bc with Priority: HIGHEST for action security_group_rules [ 678.946023] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99f9ac57-22d2-4cc7-b5b2-bd92942667bc with Priority: HIGHEST for action security_group_rules [ 678.946023] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-99f9ac57-22d2-4cc7-b5b2-bd92942667bc taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.947147] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-99f9ac57-22d2-4cc7-b5b2-bd92942667bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.947433] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-99f9ac57-22d2-4cc7-b5b2-bd92942667bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.947817] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-99f9ac57-22d2-4cc7-b5b2-bd92942667bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.949709] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('99f9ac57-22d2-4cc7-b5b2-bd92942667bc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.084128] env[68328]: INFO networking_nsxv3.common.synchronization [None req-4fd56452-ff9a-4ba8-a557-670659ff583f None None] Enqueued Resource ID: de605fab-ffca-4596-b6c6-e055c8a52365 with Priority: HIGHEST for action port [ 679.084128] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de605fab-ffca-4596-b6c6-e055c8a52365 with Priority: HIGHEST for action port [ 679.084128] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-de605fab-ffca-4596-b6c6-e055c8a52365 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.084283] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de605fab-ffca-4596-b6c6-e055c8a52365" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.084322] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de605fab-ffca-4596-b6c6-e055c8a52365" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.085481] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de605fab-ffca-4596-b6c6-e055c8a52365" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.085570] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de605fab-ffca-4596-b6c6-e055c8a52365',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.145579] env[68328]: INFO networking_nsxv3.common.synchronization [None req-6e201c23-1b9c-4ef9-9a2c-0092dcddbf85 None None] Enqueued Resource ID: e407c1c9-cd88-4d1f-b429-6e575af010e6 with Priority: HIGHEST for action port [ 679.145579] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e407c1c9-cd88-4d1f-b429-6e575af010e6 with Priority: HIGHEST for action port [ 679.145861] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-e407c1c9-cd88-4d1f-b429-6e575af010e6 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.145915] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e407c1c9-cd88-4d1f-b429-6e575af010e6" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.146054] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e407c1c9-cd88-4d1f-b429-6e575af010e6" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.147538] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e407c1c9-cd88-4d1f-b429-6e575af010e6" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.147654] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e407c1c9-cd88-4d1f-b429-6e575af010e6',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.152784] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-406 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.153088] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-406" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.153194] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-406" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.153573] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-406" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.153786] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.154092] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.154092] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.154392] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.154538] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.154713] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 679.154830] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 679.154940] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 679.155060] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 679.155174] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 679.155281] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 679.155416] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 679.180864] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 679.183798] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 679.183798] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 679.183798] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-406" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.183798] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-1fa82560-76c9-468a-94dd-4c3456b964fe taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.183798] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-1fa82560-76c9-468a-94dd-4c3456b964fe" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.183798] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-1fa82560-76c9-468a-94dd-4c3456b964fe" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.183798] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-1fa82560-76c9-468a-94dd-4c3456b964fe" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.183798] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1fa82560-76c9-468a-94dd-4c3456b964fe',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.293998] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 72ca69cd-fcd9-4815-b331-9858d9cfad42: rpc.has_security_group_logging(os_id): False [ 679.314150] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.314335] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.314494] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.314693] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.314805] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.315329] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.315591] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.315591] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.315813] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.315813] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.315922] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.316039] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.316094] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.316255] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.316305] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.316476] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.316700] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.316700] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.316879] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.316879] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.316879] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72ca69cd-fcd9-4815-b331-9858d9cfad42 is going to be created. [ 679.370289] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38 in Status: SUCCESS [ 679.370289] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.370289] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.370289] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.370289] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.374028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.374247] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.374488] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.374584] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.375243] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.375341] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.389589] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.389784] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.389888] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.390018] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.390280] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.403946] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72ca69cd-fcd9-4815-b331-9858d9cfad42 in Status: IN_PROGRESS for 2s [ 679.416249] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-739 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.416520] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-739" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.416622] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-739" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.418865] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-739" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.418865] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.418865] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.418865] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.418865] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.418865] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.418865] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 679.418865] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 679.418865] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 679.418865] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 679.418865] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 679.418865] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 679.419712] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 679.442998] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 679.442998] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 679.442998] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 679.442998] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-739" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.442998] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-346b4177-eb5e-48f0-ab00-8b5d2e85af27 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.442998] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-346b4177-eb5e-48f0-ab00-8b5d2e85af27" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.442998] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-346b4177-eb5e-48f0-ab00-8b5d2e85af27" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.442998] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-346b4177-eb5e-48f0-ab00-8b5d2e85af27" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.442998] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('346b4177-eb5e-48f0-ab00-8b5d2e85af27',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.471125] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.471514] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.471514] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.471514] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.471514] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.471658] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99f9ac57-22d2-4cc7-b5b2-bd92942667bc already deleted. [ 679.471697] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-99f9ac57-22d2-4cc7-b5b2-bd92942667bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.590160] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port de605fab-ffca-4596-b6c6-e055c8a52365 [ 679.590160] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.590160] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.590160] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.590160] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.590160] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.590160] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:de605fab-ffca-4596-b6c6-e055c8a52365 already deleted. [ 679.590160] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de605fab-ffca-4596-b6c6-e055c8a52365" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.660435] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e407c1c9-cd88-4d1f-b429-6e575af010e6 [ 679.660670] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.660820] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.660886] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.661126] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.661225] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.661306] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e407c1c9-cd88-4d1f-b429-6e575af010e6 already deleted. [ 679.661383] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e407c1c9-cd88-4d1f-b429-6e575af010e6" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.687162] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.687162] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.687162] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.687162] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.687162] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.687162] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 1fa82560-76c9-468a-94dd-4c3456b964fe not found, creating... [ 679.687162] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.687162] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.687162] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.687517] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.687517] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.688573] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.688573] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.688573] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.691409] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.691550] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.691697] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 1fa82560-76c9-468a-94dd-4c3456b964fe is going to be created. [ 679.713726] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.713726] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.713726] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.713726] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.713726] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.713726] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-1fa82560-76c9-468a-94dd-4c3456b964fe" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.742274] env[68328]: INFO networking_nsxv3.common.synchronization [req-a0c0106b-c12f-4369-9a16-51f1929d5d4a req-1591125d-e454-4c00-9880-96be6243e748 service nova] Enqueued Resource ID: 8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b with Priority: HIGHEST for action security_group_rules [ 679.742466] env[68328]: INFO networking_nsxv3.common.synchronization [req-a0c0106b-c12f-4369-9a16-51f1929d5d4a req-1591125d-e454-4c00-9880-96be6243e748 service nova] Enqueued Resource ID: 8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b with Priority: HIGHEST for action security_group_members [ 679.743137] env[68328]: INFO networking_nsxv3.common.synchronization [req-a0c0106b-c12f-4369-9a16-51f1929d5d4a req-1591125d-e454-4c00-9880-96be6243e748 service nova] Enqueued Resource ID: 7f42f847-a378-41d1-99b2-2e4565065b5f with Priority: HIGHEST for action port [ 679.743137] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b with Priority: HIGHEST for action security_group_rules [ 679.743137] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b with Priority: HIGHEST for action security_group_members [ 679.743137] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f42f847-a378-41d1-99b2-2e4565065b5f with Priority: HIGHEST for action port [ 679.743658] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.743727] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.743787] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.747961] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.747961] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.751046] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.751046] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.751046] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.751046] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.751046] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.751046] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.751046] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.751046] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.751046] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.751046] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.755155] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f42f847-a378-41d1-99b2-2e4565065b5f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.755155] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f42f847-a378-41d1-99b2-2e4565065b5f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.755155] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f42f847-a378-41d1-99b2-2e4565065b5f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.755155] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f42f847-a378-41d1-99b2-2e4565065b5f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.755155] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f42f847-a378-41d1-99b2-2e4565065b5f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.788952] env[68328]: INFO networking_nsxv3.common.synchronization [req-f522e266-ce5c-469c-837a-da0dcf40235a req-5f901a4b-daae-45e6-a608-dbe3872cca5b tempest-VolumesAssistedSnapshotsTest-819686352 tempest-VolumesAssistedSnapshotsTest-819686352-project-member] Enqueued Resource ID: 57b7bbe5-8e54-4d67-b8c6-8cfc418f7042 with Priority: HIGHEST for action security_group_members [ 679.788952] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57b7bbe5-8e54-4d67-b8c6-8cfc418f7042 with Priority: HIGHEST for action security_group_members [ 679.788952] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-57b7bbe5-8e54-4d67-b8c6-8cfc418f7042 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.789303] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57b7bbe5-8e54-4d67-b8c6-8cfc418f7042" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.789303] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57b7bbe5-8e54-4d67-b8c6-8cfc418f7042" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.789538] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57b7bbe5-8e54-4d67-b8c6-8cfc418f7042" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.789717] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.789825] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.790742] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.790742] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.790742] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.790742] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57b7bbe5-8e54-4d67-b8c6-8cfc418f7042',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.878800] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.878995] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.879059] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.879271] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.879462] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.879572] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.879703] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.879802] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.879857] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.879943] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.880260] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.880260] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.880260] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.880423] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.880699] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.880699] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.880699] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.880843] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.880843] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.880981] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.881048] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.945744] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.945955] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.946168] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.946457] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.946635] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.946808] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 346b4177-eb5e-48f0-ab00-8b5d2e85af27 not found, creating... [ 679.947084] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.947728] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.947728] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.947728] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.947728] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.948100] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.950113] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.950160] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.950399] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.950537] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.950673] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 346b4177-eb5e-48f0-ab00-8b5d2e85af27 is going to be created. [ 679.969698] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.969929] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.970061] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.970326] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.970549] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.970768] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-346b4177-eb5e-48f0-ab00-8b5d2e85af27" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.255746] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.256804] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.256804] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.257805] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7f42f847-a378-41d1-99b2-2e4565065b5f with status ACTIVE [ 680.257805] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.257805] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.257805] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.258041] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.258041] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.258242] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.258242] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.258353] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.258422] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.258496] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.258784] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.258925] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.258991] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.259304] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.259389] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.259479] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7f42f847-a378-41d1-99b2-2e4565065b5f is going to be updated. [ 680.279891] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.280089] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.280166] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.280379] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.280510] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.280669] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f42f847-a378-41d1-99b2-2e4565065b5f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.295260] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.295626] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.295626] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.295710] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.295745] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.295923] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.296031] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.296093] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.296237] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.296310] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.296393] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57b7bbe5-8e54-4d67-b8c6-8cfc418f7042 already deleted. [ 680.296472] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57b7bbe5-8e54-4d67-b8c6-8cfc418f7042" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.325375] env[68328]: INFO networking_nsxv3.common.synchronization [None req-9da5d886-aa0d-4336-a6bf-04167f4e5be9 None None] Enqueued Resource ID: 046a0388-adfb-4ed3-b1e1-c11d91167e54 with Priority: HIGHEST for action port [ 680.325663] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 046a0388-adfb-4ed3-b1e1-c11d91167e54 with Priority: HIGHEST for action port [ 680.326286] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-046a0388-adfb-4ed3-b1e1-c11d91167e54 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.326418] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-046a0388-adfb-4ed3-b1e1-c11d91167e54" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.326498] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-046a0388-adfb-4ed3-b1e1-c11d91167e54" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.326818] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-046a0388-adfb-4ed3-b1e1-c11d91167e54" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.326967] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('046a0388-adfb-4ed3-b1e1-c11d91167e54',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.383012] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38: rpc.has_security_group_logging(os_id): False [ 680.391685] env[68328]: INFO networking_nsxv3.common.synchronization [None req-36d971ef-f760-45c6-8cf3-e13b11f95cb8 None None] Enqueued Resource ID: 2b6b3565-c265-4f5a-9194-11cab7b20d6e with Priority: HIGHEST for action port [ 680.392284] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b6b3565-c265-4f5a-9194-11cab7b20d6e with Priority: HIGHEST for action port [ 680.392632] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b6b3565-c265-4f5a-9194-11cab7b20d6e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.392854] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b6b3565-c265-4f5a-9194-11cab7b20d6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.392901] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b6b3565-c265-4f5a-9194-11cab7b20d6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.393196] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b6b3565-c265-4f5a-9194-11cab7b20d6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.393292] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b6b3565-c265-4f5a-9194-11cab7b20d6e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.402339] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.402493] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.402615] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.402800] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.402908] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.403168] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.403286] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.403368] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.403544] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.403638] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.403840] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.403952] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.404097] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.404201] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.404277] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.404487] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.404593] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.404656] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.405697] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.406045] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.406045] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38 is going to be created. [ 680.446339] env[68328]: INFO networking_nsxv3.common.synchronization [req-b6093b30-4651-41e7-9f36-a49a960b50d8 req-a3543dde-4675-4f1f-aed4-95e14c1e92d7 service nova] Enqueued Resource ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc with Priority: HIGHEST for action security_group_rules [ 680.446568] env[68328]: INFO networking_nsxv3.common.synchronization [req-b6093b30-4651-41e7-9f36-a49a960b50d8 req-a3543dde-4675-4f1f-aed4-95e14c1e92d7 service nova] Enqueued Resource ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc with Priority: HIGHEST for action security_group_members [ 680.446771] env[68328]: INFO networking_nsxv3.common.synchronization [req-b6093b30-4651-41e7-9f36-a49a960b50d8 req-a3543dde-4675-4f1f-aed4-95e14c1e92d7 service nova] Enqueued Resource ID: 1fa82560-76c9-468a-94dd-4c3456b964fe with Priority: HIGHEST for action port [ 680.447210] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc with Priority: HIGHEST for action security_group_rules [ 680.447288] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc with Priority: HIGHEST for action security_group_members [ 680.447373] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fa82560-76c9-468a-94dd-4c3456b964fe with Priority: HIGHEST for action port [ 680.448071] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.448189] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.448462] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.448556] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.448800] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-1fa82560-76c9-468a-94dd-4c3456b964fe taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.449266] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1fa82560-76c9-468a-94dd-4c3456b964fe" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.449266] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1fa82560-76c9-468a-94dd-4c3456b964fe" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.449266] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1fa82560-76c9-468a-94dd-4c3456b964fe" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.449399] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1fa82560-76c9-468a-94dd-4c3456b964fe',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.473128] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.473369] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.473621] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.473896] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.475234] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.486874] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38 in Status: IN_PROGRESS for 2s [ 680.521129] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f302de28-ce4b-4460-9ba9-d832cf4c957e in Status: SUCCESS [ 680.521129] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f302de28-ce4b-4460-9ba9-d832cf4c957e deletion is rescheduled due to dependency. [ 680.521129] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.766355] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.801154] env[68328]: INFO networking_nsxv3.common.synchronization [req-a4581a1b-a1d4-46b6-845a-c8f8b7c1385f req-b0a1db8d-4b5b-4f10-af12-b22e36beca34 service nova] Enqueued Resource ID: ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 with Priority: HIGHEST for action security_group_rules [ 680.801376] env[68328]: INFO networking_nsxv3.common.synchronization [req-a4581a1b-a1d4-46b6-845a-c8f8b7c1385f req-b0a1db8d-4b5b-4f10-af12-b22e36beca34 service nova] Enqueued Resource ID: ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 with Priority: HIGHEST for action security_group_members [ 680.801526] env[68328]: INFO networking_nsxv3.common.synchronization [req-a4581a1b-a1d4-46b6-845a-c8f8b7c1385f req-b0a1db8d-4b5b-4f10-af12-b22e36beca34 service nova] Enqueued Resource ID: 346b4177-eb5e-48f0-ab00-8b5d2e85af27 with Priority: HIGHEST for action port [ 680.803478] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 with Priority: HIGHEST for action security_group_rules [ 680.803478] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 with Priority: HIGHEST for action security_group_members [ 680.803478] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 346b4177-eb5e-48f0-ab00-8b5d2e85af27 with Priority: HIGHEST for action port [ 680.803478] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.803478] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.803478] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.804686] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.804686] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ccbebeb4-60d7-4344-b96e-b9dfdeae14b1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.806473] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.809635] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.809635] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.809635] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.809635] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.809635] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.809635] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.809635] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.809635] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.809635] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ccbebeb4-60d7-4344-b96e-b9dfdeae14b1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.809963] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-346b4177-eb5e-48f0-ab00-8b5d2e85af27 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.810068] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-346b4177-eb5e-48f0-ab00-8b5d2e85af27" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.810068] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-346b4177-eb5e-48f0-ab00-8b5d2e85af27" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.810350] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-346b4177-eb5e-48f0-ab00-8b5d2e85af27" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.810433] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('346b4177-eb5e-48f0-ab00-8b5d2e85af27',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.821692] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-473 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.822077] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.822306] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.822665] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.822998] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.824609] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.824831] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.825034] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.825192] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.825498] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 680.825498] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 680.826110] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 680.826110] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 680.826110] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 680.826110] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 680.829054] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 680.834521] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 046a0388-adfb-4ed3-b1e1-c11d91167e54 [ 680.835976] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.835976] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.835976] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.839525] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.839525] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.839525] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:046a0388-adfb-4ed3-b1e1-c11d91167e54 already deleted. [ 680.839525] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-046a0388-adfb-4ed3-b1e1-c11d91167e54" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.852554] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc in Status: SUCCESS [ 680.852554] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.852554] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.852554] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.852554] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.852554] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.852554] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.853036] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.853036] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.853036] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.853036] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ba6f8661-b38c-4d97-a1c5-4a0e33e341bc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.857700] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.857700] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.857700] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.857700] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.857700] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.857700] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.857700] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.857700] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba6f8661-b38c-4d97-a1c5-4a0e33e341bc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.868673] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 680.869471] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.043 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 680.869471] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 680.869471] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.869871] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-383023e8-96b3-466c-8b0a-6c3af22944bc taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.869945] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-383023e8-96b3-466c-8b0a-6c3af22944bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.870081] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-383023e8-96b3-466c-8b0a-6c3af22944bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.870443] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-383023e8-96b3-466c-8b0a-6c3af22944bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.870555] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('383023e8-96b3-466c-8b0a-6c3af22944bc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.896080] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2b6b3565-c265-4f5a-9194-11cab7b20d6e [ 680.896080] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.896256] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.896256] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.896470] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.896558] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.896654] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2b6b3565-c265-4f5a-9194-11cab7b20d6e already deleted. [ 680.896732] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b6b3565-c265-4f5a-9194-11cab7b20d6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.952068] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1fa82560-76c9-468a-94dd-4c3456b964fe with status ACTIVE [ 680.952265] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.952712] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.952712] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.952712] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.952846] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.952956] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.953092] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.953136] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.953249] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.953320] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.953562] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.953636] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.953636] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.953940] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.953940] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.954058] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1fa82560-76c9-468a-94dd-4c3456b964fe is going to be updated. [ 680.974579] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.974730] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.974795] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.975073] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.975216] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.975331] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1fa82560-76c9-468a-94dd-4c3456b964fe" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.175044] env[68328]: INFO networking_nsxv3.common.synchronization [None req-32ac993c-fe70-4c1a-b3e3-45130b14634f tempest-AttachInterfacesTestJSON-966841523 tempest-AttachInterfacesTestJSON-966841523-project-member] Enqueued Resource ID: 76f74d16-9031-4472-a81b-f9ada0520a34 with Priority: HIGHEST for action security_group_rules [ 681.175416] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76f74d16-9031-4472-a81b-f9ada0520a34 with Priority: HIGHEST for action security_group_rules [ 681.175911] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76f74d16-9031-4472-a81b-f9ada0520a34 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.176469] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76f74d16-9031-4472-a81b-f9ada0520a34" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.176588] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76f74d16-9031-4472-a81b-f9ada0520a34" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.176853] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76f74d16-9031-4472-a81b-f9ada0520a34" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.176944] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76f74d16-9031-4472-a81b-f9ada0520a34',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.266897] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.267099] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.267154] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.267351] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.267436] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.267533] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b is going to be created. [ 681.299096] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.299096] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.299096] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.299781] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.299933] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.315025] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b in Status: UNINITIALIZED for 2s [ 681.315025] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.315025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.315025] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ccbebeb4-60d7-4344-b96e-b9dfdeae14b1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.315025] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 346b4177-eb5e-48f0-ab00-8b5d2e85af27 with status ACTIVE [ 681.315025] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.315025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.315025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.315025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.315025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.315713] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.315997] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.316168] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.316409] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.317101] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.317443] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.317673] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.317815] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.318067] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.324291] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.324291] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 346b4177-eb5e-48f0-ab00-8b5d2e85af27 is going to be updated. [ 681.341949] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.341949] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.341949] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.341949] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.341949] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.341949] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-346b4177-eb5e-48f0-ab00-8b5d2e85af27" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.357088] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.357088] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.357088] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ba6f8661-b38c-4d97-a1c5-4a0e33e341bc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.376250] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.376250] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.376250] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.376250] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.376250] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.376250] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 383023e8-96b3-466c-8b0a-6c3af22944bc not found, creating... [ 681.376250] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.376250] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.376250] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.376250] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.376250] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.377751] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.378198] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.378843] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.380830] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.380830] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.380830] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 383023e8-96b3-466c-8b0a-6c3af22944bc is going to be created. [ 681.383464] env[68328]: INFO networking_nsxv3.common.synchronization [None req-6e839803-a22c-4779-ae21-13dc140af840 tempest-AttachInterfacesTestJSON-966841523 tempest-AttachInterfacesTestJSON-966841523-project-member] Enqueued Resource ID: 76f74d16-9031-4472-a81b-f9ada0520a34 with Priority: HIGHEST for action security_group_rules [ 681.385500] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76f74d16-9031-4472-a81b-f9ada0520a34 with Priority: HIGHEST for action security_group_rules [ 681.386191] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76f74d16-9031-4472-a81b-f9ada0520a34 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.386415] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76f74d16-9031-4472-a81b-f9ada0520a34" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.418509] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.418509] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.418509] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.418509] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.418509] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.418509] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-383023e8-96b3-466c-8b0a-6c3af22944bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.421874] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72ca69cd-fcd9-4815-b331-9858d9cfad42 in Status: SUCCESS [ 681.422348] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72ca69cd-fcd9-4815-b331-9858d9cfad42" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.484292] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-340 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.484292] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-340" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.484292] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-340" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.484292] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-340" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.484820] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.485137] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.486008] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.486417] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.487272] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.487654] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 681.490020] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 681.490020] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 681.490020] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 681.490020] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 681.490020] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 681.490020] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 681.519023] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 681.519023] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 681.519023] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 681.519023] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-340" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.519023] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-828dcd43-9a65-4652-b3f5-f6e47822d1a5 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.519023] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-828dcd43-9a65-4652-b3f5-f6e47822d1a5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.519023] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-828dcd43-9a65-4652-b3f5-f6e47822d1a5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.520047] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-828dcd43-9a65-4652-b3f5-f6e47822d1a5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.520359] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('828dcd43-9a65-4652-b3f5-f6e47822d1a5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.700019] env[68328]: INFO networking_nsxv3.common.synchronization [req-fd8de8fe-a954-4ab4-bdfa-173f0d2bc65c req-14b0a0cd-ca29-4712-9b79-a3426cc0b9bd tempest-ServersWithSpecificFlavorTestJSON-2033217338 tempest-ServersWithSpecificFlavorTestJSON-2033217338-project-member] Enqueued Resource ID: 3e399462-679e-43d6-8b03-2876938fc726 with Priority: HIGHEST for action security_group_members [ 681.700019] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.700019] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.700019] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.700272] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.700272] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.700272] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76f74d16-9031-4472-a81b-f9ada0520a34 already deleted. [ 681.700375] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76f74d16-9031-4472-a81b-f9ada0520a34" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.700828] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e399462-679e-43d6-8b03-2876938fc726 with Priority: HIGHEST for action security_group_members [ 681.700993] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76f74d16-9031-4472-a81b-f9ada0520a34" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.701180] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76f74d16-9031-4472-a81b-f9ada0520a34" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.701259] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76f74d16-9031-4472-a81b-f9ada0520a34',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.702134] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e399462-679e-43d6-8b03-2876938fc726 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.702241] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.704411] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.704689] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.704860] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.704966] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.705040] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.705257] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.705304] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.705511] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e399462-679e-43d6-8b03-2876938fc726',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.825812] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ccbebeb4-60d7-4344-b96e-b9dfdeae14b1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.859696] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ba6f8661-b38c-4d97-a1c5-4a0e33e341bc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.023779] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.024064] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.024216] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.024537] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.024721] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.024885] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 828dcd43-9a65-4652-b3f5-f6e47822d1a5 not found, creating... [ 682.025176] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.025538] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.025642] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.025982] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.026211] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.026665] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.030658] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.030658] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.030890] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.030890] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.031069] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 828dcd43-9a65-4652-b3f5-f6e47822d1a5 is going to be created. [ 682.055253] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.055253] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.055253] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.055253] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.055253] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.055253] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-828dcd43-9a65-4652-b3f5-f6e47822d1a5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.214826] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.214826] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.214826] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.214826] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.214826] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.214826] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.214826] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.214826] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.214826] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.214826] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.214826] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e399462-679e-43d6-8b03-2876938fc726 already deleted. [ 682.214826] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.225886] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.225886] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.225886] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.225886] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.225886] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.225886] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76f74d16-9031-4472-a81b-f9ada0520a34 already deleted. [ 682.225886] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76f74d16-9031-4472-a81b-f9ada0520a34" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.331029] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.331029] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.331029] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.331029] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.331029] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.331029] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 is going to be created. [ 682.356556] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.356556] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.356556] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.356556] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.356556] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.364820] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.364820] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.364820] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.364820] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.364820] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.364820] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc is going to be updated. [ 682.364820] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 in Status: UNINITIALIZED for 2s [ 682.391384] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.395179] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.395179] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.395179] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.395179] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.404198] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc in Status: IN_PROGRESS for 2s [ 682.501312] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38 in Status: SUCCESS [ 682.502780] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.860503] env[68328]: INFO networking_nsxv3.common.synchronization [req-f522e266-ce5c-469c-837a-da0dcf40235a req-a30ad978-297e-4b1a-be7c-0f4401af35a8 service nova] Enqueued Resource ID: 57b7bbe5-8e54-4d67-b8c6-8cfc418f7042 with Priority: HIGHEST for action security_group_rules [ 682.860683] env[68328]: INFO networking_nsxv3.common.synchronization [req-f522e266-ce5c-469c-837a-da0dcf40235a req-a30ad978-297e-4b1a-be7c-0f4401af35a8 service nova] Enqueued Resource ID: 57b7bbe5-8e54-4d67-b8c6-8cfc418f7042 with Priority: HIGHEST for action security_group_members [ 682.860825] env[68328]: INFO networking_nsxv3.common.synchronization [req-f522e266-ce5c-469c-837a-da0dcf40235a req-a30ad978-297e-4b1a-be7c-0f4401af35a8 service nova] Enqueued Resource ID: 383023e8-96b3-466c-8b0a-6c3af22944bc with Priority: HIGHEST for action port [ 682.861102] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57b7bbe5-8e54-4d67-b8c6-8cfc418f7042 with Priority: HIGHEST for action security_group_rules [ 682.861239] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57b7bbe5-8e54-4d67-b8c6-8cfc418f7042 with Priority: HIGHEST for action security_group_members [ 682.861346] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 383023e8-96b3-466c-8b0a-6c3af22944bc with Priority: HIGHEST for action port [ 682.861913] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57b7bbe5-8e54-4d67-b8c6-8cfc418f7042 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.863210] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57b7bbe5-8e54-4d67-b8c6-8cfc418f7042" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.863736] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57b7bbe5-8e54-4d67-b8c6-8cfc418f7042" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.863985] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57b7bbe5-8e54-4d67-b8c6-8cfc418f7042" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.864085] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57b7bbe5-8e54-4d67-b8c6-8cfc418f7042',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.865719] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-57b7bbe5-8e54-4d67-b8c6-8cfc418f7042 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.865719] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57b7bbe5-8e54-4d67-b8c6-8cfc418f7042" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.865719] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57b7bbe5-8e54-4d67-b8c6-8cfc418f7042" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.865719] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57b7bbe5-8e54-4d67-b8c6-8cfc418f7042" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.865719] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.865719] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.865719] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.865719] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.866390] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.866390] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57b7bbe5-8e54-4d67-b8c6-8cfc418f7042',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.869723] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-383023e8-96b3-466c-8b0a-6c3af22944bc taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.869723] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-383023e8-96b3-466c-8b0a-6c3af22944bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.869723] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-383023e8-96b3-466c-8b0a-6c3af22944bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.869723] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-383023e8-96b3-466c-8b0a-6c3af22944bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.869723] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('383023e8-96b3-466c-8b0a-6c3af22944bc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.890776] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-657 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.891257] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-657" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.891257] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-657" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.891426] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-657" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.891703] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.892098] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.892098] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.892974] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.893020] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.893764] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 682.893764] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 682.893764] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 682.893764] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 682.893948] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 682.894278] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 682.894502] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 682.913312] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 682.913376] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 682.913479] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 682.913657] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-657" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.913977] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-c580e293-f0fc-414b-b6fa-315c8a77545e taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.914187] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-c580e293-f0fc-414b-b6fa-315c8a77545e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.914306] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-c580e293-f0fc-414b-b6fa-315c8a77545e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.914634] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-c580e293-f0fc-414b-b6fa-315c8a77545e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.914771] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c580e293-f0fc-414b-b6fa-315c8a77545e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.990296] env[68328]: INFO networking_nsxv3.common.synchronization [req-b6093b30-4651-41e7-9f36-a49a960b50d8 req-c5c319a6-1de8-4381-85a8-dcd6e7cad9b2 service nova] Enqueued Resource ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc with Priority: HIGHEST for action security_group_rules [ 682.990397] env[68328]: INFO networking_nsxv3.common.synchronization [req-b6093b30-4651-41e7-9f36-a49a960b50d8 req-c5c319a6-1de8-4381-85a8-dcd6e7cad9b2 service nova] Enqueued Resource ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc with Priority: HIGHEST for action security_group_members [ 682.990529] env[68328]: INFO networking_nsxv3.common.synchronization [req-b6093b30-4651-41e7-9f36-a49a960b50d8 req-c5c319a6-1de8-4381-85a8-dcd6e7cad9b2 service nova] Enqueued Resource ID: 828dcd43-9a65-4652-b3f5-f6e47822d1a5 with Priority: HIGHEST for action port [ 682.991161] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc with Priority: HIGHEST for action security_group_rules [ 682.991359] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc with Priority: HIGHEST for action security_group_members [ 682.991501] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 828dcd43-9a65-4652-b3f5-f6e47822d1a5 with Priority: HIGHEST for action port [ 682.991882] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.993784] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.993784] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.993784] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.993784] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-828dcd43-9a65-4652-b3f5-f6e47822d1a5 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.993784] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-828dcd43-9a65-4652-b3f5-f6e47822d1a5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.993784] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-828dcd43-9a65-4652-b3f5-f6e47822d1a5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.993784] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-828dcd43-9a65-4652-b3f5-f6e47822d1a5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.993784] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('828dcd43-9a65-4652-b3f5-f6e47822d1a5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.323792] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b in Status: SUCCESS [ 683.323792] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.323792] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.323792] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.323792] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.323792] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.323792] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.323792] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.323792] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.323792] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.323792] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.371111] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-57b7bbe5-8e54-4d67-b8c6-8cfc418f7042 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.371582] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57b7bbe5-8e54-4d67-b8c6-8cfc418f7042" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.371582] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57b7bbe5-8e54-4d67-b8c6-8cfc418f7042',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.372556] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 383023e8-96b3-466c-8b0a-6c3af22944bc with status ACTIVE [ 683.373130] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.373989] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.373989] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.373989] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.373989] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.373989] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.375348] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.375348] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.375348] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.375348] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.375348] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.376930] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.376930] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.376930] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.376930] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.376930] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 383023e8-96b3-466c-8b0a-6c3af22944bc is going to be updated. [ 683.402447] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.402447] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.402447] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.402661] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.402661] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.402810] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-383023e8-96b3-466c-8b0a-6c3af22944bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.417217] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.417463] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.417590] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.417883] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.418045] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.418204] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port c580e293-f0fc-414b-b6fa-315c8a77545e not found, creating... [ 683.418465] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.418622] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.418934] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.419224] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.419379] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.420775] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.421071] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.421254] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.421537] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.421740] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.421940] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: c580e293-f0fc-414b-b6fa-315c8a77545e is going to be created. [ 683.447361] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.447572] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.447706] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.447985] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.448247] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.448473] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-c580e293-f0fc-414b-b6fa-315c8a77545e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.471102] env[68328]: INFO networking_nsxv3.common.synchronization [None req-77b00995-f51a-4df2-8319-bb02cfd0b291 None None] Enqueued Resource ID: a53b1301-00d8-44c0-b1e3-2fde44a5e3e8 with Priority: HIGHEST for action port [ 683.471805] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a53b1301-00d8-44c0-b1e3-2fde44a5e3e8 with Priority: HIGHEST for action port [ 683.472270] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-a53b1301-00d8-44c0-b1e3-2fde44a5e3e8 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.472543] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a53b1301-00d8-44c0-b1e3-2fde44a5e3e8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.472543] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a53b1301-00d8-44c0-b1e3-2fde44a5e3e8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.473334] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a53b1301-00d8-44c0-b1e3-2fde44a5e3e8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.473334] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a53b1301-00d8-44c0-b1e3-2fde44a5e3e8',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.494946] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 828dcd43-9a65-4652-b3f5-f6e47822d1a5 with status ACTIVE [ 683.495205] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.495344] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.495854] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.496118] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.496260] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.496403] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.496655] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.496655] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.496748] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.496778] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.496959] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.497056] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.497393] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.497393] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.497393] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.497393] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 828dcd43-9a65-4652-b3f5-f6e47822d1a5 is going to be updated. [ 683.532715] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.533151] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.533151] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.533399] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.533649] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.533854] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-828dcd43-9a65-4652-b3f5-f6e47822d1a5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.826019] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.826226] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.826291] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.826484] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.826692] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.826789] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.826932] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.827018] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.827108] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.827200] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.827345] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.827448] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.827585] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.827707] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.827787] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.827851] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.827918] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.828194] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.828194] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.828274] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.828333] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.882057] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57b7bbe5-8e54-4d67-b8c6-8cfc418f7042',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.978421] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a53b1301-00d8-44c0-b1e3-2fde44a5e3e8 [ 683.978774] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.978946] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.979036] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.979727] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.979727] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.979727] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a53b1301-00d8-44c0-b1e3-2fde44a5e3e8 already deleted. [ 683.979727] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a53b1301-00d8-44c0-b1e3-2fde44a5e3e8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.330320] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b: rpc.has_security_group_logging(os_id): False [ 684.358460] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.358460] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.358460] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.359069] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.359178] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.359449] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.359515] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.359549] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.359726] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.360160] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.360160] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.360160] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.360160] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.360350] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.360350] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.363362] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.363362] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.363362] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.363362] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.363362] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.363362] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b is going to be created. [ 684.377023] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 in Status: SUCCESS [ 684.377023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.377023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.377023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.377023] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.377023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.377023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.377023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.377023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.377023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.377023] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ccbebeb4-60d7-4344-b96e-b9dfdeae14b1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.385682] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.385842] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.385891] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.386533] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.386628] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.386756] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57b7bbe5-8e54-4d67-b8c6-8cfc418f7042 is going to be created. [ 684.409907] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.409907] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.409907] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.409907] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.409907] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.426735] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.426735] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.426735] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.426735] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.426735] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.428801] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc in Status: SUCCESS [ 684.431025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.431025] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57b7bbe5-8e54-4d67-b8c6-8cfc418f7042 in Status: UNINITIALIZED for 2s [ 684.431025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.431025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.431025] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.431025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.431025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.432200] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.432200] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.432469] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.433136] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.433136] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.433136] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.433527] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.433695] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.433835] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.433876] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.435122] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.435122] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.435122] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.435122] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ba6f8661-b38c-4d97-a1c5-4a0e33e341bc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.435711] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.435711] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.435711] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.435878] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.435878] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.435955] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.435988] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.436097] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba6f8661-b38c-4d97-a1c5-4a0e33e341bc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.437496] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b in Status: IN_PROGRESS for 2s [ 684.645639] env[68328]: INFO networking_nsxv3.common.synchronization [req-2481da97-ef89-4de7-a23b-1d27e03f2588 req-ecc05e6a-5f3d-4a17-a3e2-0641b2479946 tempest-ImagesNegativeTestJSON-174892724 tempest-ImagesNegativeTestJSON-174892724-project-member] Enqueued Resource ID: c8026099-4b7a-433d-98f2-b33d3f0a6907 with Priority: HIGHEST for action security_group_members [ 684.645639] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8026099-4b7a-433d-98f2-b33d3f0a6907 with Priority: HIGHEST for action security_group_members [ 684.645639] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8026099-4b7a-433d-98f2-b33d3f0a6907 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.645639] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8026099-4b7a-433d-98f2-b33d3f0a6907" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.645639] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8026099-4b7a-433d-98f2-b33d3f0a6907" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.645639] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8026099-4b7a-433d-98f2-b33d3f0a6907" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.645639] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.645639] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.645967] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.645967] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.645967] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.646180] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8026099-4b7a-433d-98f2-b33d3f0a6907',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.881082] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.881082] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.881082] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.881082] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.881082] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.881082] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.881082] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.881082] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.881082] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.885982] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.885982] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.885982] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.885982] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.885982] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.885982] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.885982] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.885982] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.885982] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.885982] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.885982] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.885982] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ccbebeb4-60d7-4344-b96e-b9dfdeae14b1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.885982] env[68328]: INFO networking_nsxv3.common.synchronization [req-fd8de8fe-a954-4ab4-bdfa-173f0d2bc65c req-ac1946d2-4cb2-49af-ba68-da743ab1e471 service nova] Enqueued Resource ID: 3e399462-679e-43d6-8b03-2876938fc726 with Priority: HIGHEST for action security_group_rules [ 684.885982] env[68328]: INFO networking_nsxv3.common.synchronization [req-fd8de8fe-a954-4ab4-bdfa-173f0d2bc65c req-ac1946d2-4cb2-49af-ba68-da743ab1e471 service nova] Enqueued Resource ID: 3e399462-679e-43d6-8b03-2876938fc726 with Priority: HIGHEST for action security_group_members [ 684.885982] env[68328]: INFO networking_nsxv3.common.synchronization [req-fd8de8fe-a954-4ab4-bdfa-173f0d2bc65c req-ac1946d2-4cb2-49af-ba68-da743ab1e471 service nova] Enqueued Resource ID: c580e293-f0fc-414b-b6fa-315c8a77545e with Priority: HIGHEST for action port [ 684.886721] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e399462-679e-43d6-8b03-2876938fc726 with Priority: HIGHEST for action security_group_rules [ 684.886721] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e399462-679e-43d6-8b03-2876938fc726 with Priority: HIGHEST for action security_group_members [ 684.886721] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c580e293-f0fc-414b-b6fa-315c8a77545e with Priority: HIGHEST for action port [ 684.887357] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e399462-679e-43d6-8b03-2876938fc726 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.887357] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.887357] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.887965] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.887965] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e399462-679e-43d6-8b03-2876938fc726',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.888456] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e399462-679e-43d6-8b03-2876938fc726 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.888772] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.888772] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.888979] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.889074] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.889199] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.889282] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.889446] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.889552] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.889660] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e399462-679e-43d6-8b03-2876938fc726',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.890666] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-c580e293-f0fc-414b-b6fa-315c8a77545e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.890808] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c580e293-f0fc-414b-b6fa-315c8a77545e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.890897] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c580e293-f0fc-414b-b6fa-315c8a77545e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.891090] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c580e293-f0fc-414b-b6fa-315c8a77545e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.891193] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c580e293-f0fc-414b-b6fa-315c8a77545e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.939559] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ba6f8661-b38c-4d97-a1c5-4a0e33e341bc: rpc.has_security_group_logging(os_id): False [ 684.940934] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ba6f8661-b38c-4d97-a1c5-4a0e33e341bc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.959362] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.959536] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.959609] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.959879] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.960086] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.960238] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.960417] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.960417] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.960573] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.960668] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.960883] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.960987] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.961067] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.961265] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.961345] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.961545] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.961643] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.961704] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.961848] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.961924] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.962014] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc is going to be created. [ 685.017344] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.017495] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.017566] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.017779] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.017956] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.030514] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc in Status: IN_PROGRESS for 2s [ 685.149089] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.149255] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.149314] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.149484] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.149576] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.149760] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.149858] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.150044] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.150433] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.150582] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.150691] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8026099-4b7a-433d-98f2-b33d3f0a6907 already deleted. [ 685.150803] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8026099-4b7a-433d-98f2-b33d3f0a6907" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.387396] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ccbebeb4-60d7-4344-b96e-b9dfdeae14b1: rpc.has_security_group_logging(os_id): False [ 685.396025] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e399462-679e-43d6-8b03-2876938fc726 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.396025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.396025] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e399462-679e-43d6-8b03-2876938fc726',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.396025] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c580e293-f0fc-414b-b6fa-315c8a77545e with status ACTIVE [ 685.396025] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.396025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.396025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.396576] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.396576] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.396576] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.396576] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.396576] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.396745] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.396786] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.396943] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.397048] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.400144] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.400413] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.400516] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.400616] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c580e293-f0fc-414b-b6fa-315c8a77545e is going to be updated. [ 685.406522] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.406522] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.406522] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.406522] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.406522] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.406522] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.406522] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.406522] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.406522] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.406522] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.406522] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.406522] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.406522] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.406522] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.406522] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.407093] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.407093] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.407093] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.407093] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.407093] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.407093] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 is going to be created. [ 685.418937] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.418937] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.418937] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.418937] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.419177] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.419177] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c580e293-f0fc-414b-b6fa-315c8a77545e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.444213] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ba6f8661-b38c-4d97-a1c5-4a0e33e341bc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.452173] env[68328]: INFO networking_nsxv3.common.synchronization [None req-74e22f93-359f-4524-b01b-eb7ec134d65b tempest-ServersV294TestFqdnHostnames-1189707928 tempest-ServersV294TestFqdnHostnames-1189707928-project-member] Enqueued Resource ID: 14cff10c-171f-4bbf-8531-6de5c6c7cc48 with Priority: HIGHEST for action security_group_rules [ 685.454119] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14cff10c-171f-4bbf-8531-6de5c6c7cc48 with Priority: HIGHEST for action security_group_rules [ 685.454119] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14cff10c-171f-4bbf-8531-6de5c6c7cc48 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.454232] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14cff10c-171f-4bbf-8531-6de5c6c7cc48" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.454342] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14cff10c-171f-4bbf-8531-6de5c6c7cc48" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.454606] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14cff10c-171f-4bbf-8531-6de5c6c7cc48" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.454687] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14cff10c-171f-4bbf-8531-6de5c6c7cc48',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.468777] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.468995] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.469108] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.469911] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.469911] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.483206] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 in Status: IN_PROGRESS for 2s [ 685.607504] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-992 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.607504] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-992" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.607504] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-992" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.607504] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-992" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.607504] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.607504] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.607504] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.607504] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.607504] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.608296] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 685.608296] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 685.608296] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 685.608296] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 685.608296] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 685.608296] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 685.608499] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 685.627808] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 685.627977] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 685.628146] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 685.628451] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-992" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.628832] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-409e16ff-ee47-4470-9d04-898749cecb73 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.629030] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-409e16ff-ee47-4470-9d04-898749cecb73" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.629153] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-409e16ff-ee47-4470-9d04-898749cecb73" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.629488] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-409e16ff-ee47-4470-9d04-898749cecb73" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.629622] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('409e16ff-ee47-4470-9d04-898749cecb73',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.749810] env[68328]: INFO networking_nsxv3.common.synchronization [None req-aada5ebd-8322-40f9-adaf-0afce8087c1d tempest-ServersV294TestFqdnHostnames-1189707928 tempest-ServersV294TestFqdnHostnames-1189707928-project-member] Enqueued Resource ID: 14cff10c-171f-4bbf-8531-6de5c6c7cc48 with Priority: HIGHEST for action security_group_rules [ 685.750936] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14cff10c-171f-4bbf-8531-6de5c6c7cc48 with Priority: HIGHEST for action security_group_rules [ 685.750936] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14cff10c-171f-4bbf-8531-6de5c6c7cc48 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.750936] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14cff10c-171f-4bbf-8531-6de5c6c7cc48" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.836767] env[68328]: INFO networking_nsxv3.common.synchronization [None req-f35c77ea-9721-4cf4-a2be-2891fd820fc5 None None] Enqueued Resource ID: 980248e1-c1ff-46a3-a8ca-b0a44a43eb0b with Priority: HIGHEST for action port [ 685.837375] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 980248e1-c1ff-46a3-a8ca-b0a44a43eb0b with Priority: HIGHEST for action port [ 685.837704] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-980248e1-c1ff-46a3-a8ca-b0a44a43eb0b taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.837827] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-980248e1-c1ff-46a3-a8ca-b0a44a43eb0b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.837890] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-980248e1-c1ff-46a3-a8ca-b0a44a43eb0b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.838188] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-980248e1-c1ff-46a3-a8ca-b0a44a43eb0b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.838274] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('980248e1-c1ff-46a3-a8ca-b0a44a43eb0b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.904114] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e399462-679e-43d6-8b03-2876938fc726',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.947631] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.948498] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.948498] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.948498] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.948498] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.948498] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc is going to be updated. [ 685.974221] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.974362] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.974461] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.974767] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.974870] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.974982] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14cff10c-171f-4bbf-8531-6de5c6c7cc48 already deleted. [ 685.975089] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14cff10c-171f-4bbf-8531-6de5c6c7cc48" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.975241] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14cff10c-171f-4bbf-8531-6de5c6c7cc48" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.975739] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14cff10c-171f-4bbf-8531-6de5c6c7cc48" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.975739] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14cff10c-171f-4bbf-8531-6de5c6c7cc48',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.977299] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.977452] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.977511] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.977657] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.977818] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.985558] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc in Status: IN_PROGRESS for 2s [ 686.132556] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.132789] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.132916] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.133507] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.133507] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.133644] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 409e16ff-ee47-4470-9d04-898749cecb73 not found, creating... [ 686.133902] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.134048] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.134188] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.134445] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.134607] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.134930] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.135417] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.135417] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.135569] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.135733] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.136338] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 409e16ff-ee47-4470-9d04-898749cecb73 is going to be created. [ 686.162201] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.162423] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.162549] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.162826] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.163064] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.163301] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-409e16ff-ee47-4470-9d04-898749cecb73" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.342109] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 980248e1-c1ff-46a3-a8ca-b0a44a43eb0b [ 686.342109] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.342109] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.342109] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.342109] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.342109] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.342109] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:980248e1-c1ff-46a3-a8ca-b0a44a43eb0b already deleted. [ 686.342109] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-980248e1-c1ff-46a3-a8ca-b0a44a43eb0b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.407745] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.407745] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.407745] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.407745] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.407745] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.407745] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e399462-679e-43d6-8b03-2876938fc726 is going to be created. [ 686.431310] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.431310] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.431310] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.431310] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.431310] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.443023] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57b7bbe5-8e54-4d67-b8c6-8cfc418f7042 in Status: SUCCESS [ 686.443023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57b7bbe5-8e54-4d67-b8c6-8cfc418f7042" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.443023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57b7bbe5-8e54-4d67-b8c6-8cfc418f7042" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.443023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57b7bbe5-8e54-4d67-b8c6-8cfc418f7042" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.443023] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.443023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.443023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.443023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.443023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.443023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57b7bbe5-8e54-4d67-b8c6-8cfc418f7042" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.443023] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57b7bbe5-8e54-4d67-b8c6-8cfc418f7042',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.444260] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e399462-679e-43d6-8b03-2876938fc726 in Status: UNINITIALIZED for 2s [ 686.447743] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b in Status: SUCCESS [ 686.448544] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.495820] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.495988] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.496095] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.496345] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.496449] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.496651] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14cff10c-171f-4bbf-8531-6de5c6c7cc48 already deleted. [ 686.496753] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14cff10c-171f-4bbf-8531-6de5c6c7cc48" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.946331] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57b7bbe5-8e54-4d67-b8c6-8cfc418f7042',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.041865] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc in Status: SUCCESS [ 687.042193] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.042957] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.043328] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.043825] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba6f8661-b38c-4d97-a1c5-4a0e33e341bc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.131024] env[68328]: INFO networking_nsxv3.common.synchronization [req-c18bb7dd-4ff3-4939-a649-72604f626d30 req-6c2f3504-f1af-4e7e-b853-fd2f26b50b4f tempest-MultipleCreateTestJSON-885002055 tempest-MultipleCreateTestJSON-885002055-project-member] Enqueued Resource ID: 96047272-421b-4187-99a6-e18e4a01bfc9 with Priority: HIGHEST for action security_group_members [ 687.131482] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96047272-421b-4187-99a6-e18e4a01bfc9 with Priority: HIGHEST for action security_group_members [ 687.132021] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-96047272-421b-4187-99a6-e18e4a01bfc9 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.132231] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.132341] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.133325] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.134492] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.134492] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.134492] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.134774] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.134774] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.135755] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('96047272-421b-4187-99a6-e18e4a01bfc9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.449606] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57b7bbe5-8e54-4d67-b8c6-8cfc418f7042: rpc.has_security_group_logging(os_id): False [ 687.469671] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.469935] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.470051] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.470369] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.470493] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.470785] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.470936] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.471098] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.471241] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.475427] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.475694] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57b7bbe5-8e54-4d67-b8c6-8cfc418f7042 is going to be created. [ 687.497521] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 in Status: SUCCESS [ 687.499680] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.535814] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.535814] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.536122] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.536311] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.536602] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.547146] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.547349] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.548696] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57b7bbe5-8e54-4d67-b8c6-8cfc418f7042 in Status: IN_PROGRESS for 2s [ 687.559348] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-133 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.560930] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-133" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.560930] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-133" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.560930] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-133" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.561371] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.561371] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.561581] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.561913] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.562145] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.562657] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 687.562657] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 687.562819] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 687.563041] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 687.563230] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 687.563396] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 687.563657] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 687.584369] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 687.584369] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 687.584477] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 687.584627] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-133" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.584966] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-d3284395-bb78-4ab3-897b-e895f46a37c2 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.585164] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-d3284395-bb78-4ab3-897b-e895f46a37c2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.585285] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-d3284395-bb78-4ab3-897b-e895f46a37c2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.585646] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-d3284395-bb78-4ab3-897b-e895f46a37c2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.585792] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3284395-bb78-4ab3-897b-e895f46a37c2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.634073] env[68328]: INFO networking_nsxv3.common.synchronization [req-2481da97-ef89-4de7-a23b-1d27e03f2588 req-f8104bc8-8039-4cf9-816b-7911322bfb3b service nova] Enqueued Resource ID: c8026099-4b7a-433d-98f2-b33d3f0a6907 with Priority: HIGHEST for action security_group_rules [ 687.634319] env[68328]: INFO networking_nsxv3.common.synchronization [req-2481da97-ef89-4de7-a23b-1d27e03f2588 req-f8104bc8-8039-4cf9-816b-7911322bfb3b service nova] Enqueued Resource ID: c8026099-4b7a-433d-98f2-b33d3f0a6907 with Priority: HIGHEST for action security_group_members [ 687.634417] env[68328]: INFO networking_nsxv3.common.synchronization [req-2481da97-ef89-4de7-a23b-1d27e03f2588 req-f8104bc8-8039-4cf9-816b-7911322bfb3b service nova] Enqueued Resource ID: 409e16ff-ee47-4470-9d04-898749cecb73 with Priority: HIGHEST for action port [ 687.634995] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8026099-4b7a-433d-98f2-b33d3f0a6907 with Priority: HIGHEST for action security_group_rules [ 687.635379] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8026099-4b7a-433d-98f2-b33d3f0a6907 with Priority: HIGHEST for action security_group_members [ 687.635513] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 409e16ff-ee47-4470-9d04-898749cecb73 with Priority: HIGHEST for action port [ 687.635839] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c8026099-4b7a-433d-98f2-b33d3f0a6907 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.635976] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c8026099-4b7a-433d-98f2-b33d3f0a6907" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.636053] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c8026099-4b7a-433d-98f2-b33d3f0a6907" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.636333] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c8026099-4b7a-433d-98f2-b33d3f0a6907" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.636418] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c8026099-4b7a-433d-98f2-b33d3f0a6907',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.637417] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8026099-4b7a-433d-98f2-b33d3f0a6907 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.637575] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8026099-4b7a-433d-98f2-b33d3f0a6907" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.637635] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8026099-4b7a-433d-98f2-b33d3f0a6907" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.637783] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8026099-4b7a-433d-98f2-b33d3f0a6907" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.638218] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.638218] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.638218] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.638471] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.638471] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.638471] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8026099-4b7a-433d-98f2-b33d3f0a6907',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.639523] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-409e16ff-ee47-4470-9d04-898749cecb73 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.640056] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-409e16ff-ee47-4470-9d04-898749cecb73" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.640137] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-409e16ff-ee47-4470-9d04-898749cecb73" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.640323] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-409e16ff-ee47-4470-9d04-898749cecb73" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.640479] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('409e16ff-ee47-4470-9d04-898749cecb73',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.646169] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.647034] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.647034] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.647034] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.647034] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.647468] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.647468] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.647468] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.647875] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.647875] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.647875] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96047272-421b-4187-99a6-e18e4a01bfc9 already deleted. [ 687.647875] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.994686] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc in Status: SUCCESS [ 687.994896] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.995072] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.995281] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.995465] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.995579] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.995640] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.995794] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.995869] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.995951] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.997015] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ba6f8661-b38c-4d97-a1c5-4a0e33e341bc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.091869] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.091869] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.091869] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.092419] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.092419] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.092548] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port d3284395-bb78-4ab3-897b-e895f46a37c2 not found, creating... [ 688.092741] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.092917] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.093049] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.093301] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.093438] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.093721] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.093877] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.093992] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.094906] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.097954] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.097954] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: d3284395-bb78-4ab3-897b-e895f46a37c2 is going to be created. [ 688.114957] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.115735] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.115735] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.115735] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.115959] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.118189] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-d3284395-bb78-4ab3-897b-e895f46a37c2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.143468] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c8026099-4b7a-433d-98f2-b33d3f0a6907',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.144676] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8026099-4b7a-433d-98f2-b33d3f0a6907 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.144798] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8026099-4b7a-433d-98f2-b33d3f0a6907" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.144937] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 409e16ff-ee47-4470-9d04-898749cecb73 with status ACTIVE [ 688.145110] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.145213] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.145271] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.145482] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.145567] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.145736] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.145830] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.145891] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.146203] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.146296] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.146487] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.146624] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.146898] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.146975] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.147077] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.147640] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 409e16ff-ee47-4470-9d04-898749cecb73 is going to be updated. [ 688.179427] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.179606] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.179652] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.179887] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.180022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.180552] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-409e16ff-ee47-4470-9d04-898749cecb73" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.455334] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e399462-679e-43d6-8b03-2876938fc726 in Status: SUCCESS [ 688.456440] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.456440] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.456440] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.456440] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.456440] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.456440] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.456840] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.456840] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.456840] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.456840] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3e399462-679e-43d6-8b03-2876938fc726',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.502487] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.502658] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.502721] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.502959] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.503183] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.503307] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.503379] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.503527] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.503630] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.503703] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.503858] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.503936] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.503987] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.504266] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.504266] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.504426] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.504426] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.504535] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.504585] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.504750] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.504750] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ba6f8661-b38c-4d97-a1c5-4a0e33e341bc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.518553] env[68328]: INFO networking_nsxv3.common.synchronization [None req-449322a7-66ba-4a4c-8038-44239beb8c42 None None] Enqueued Resource ID: da9c6c55-320d-4b40-84b2-934b0cfb4330 with Priority: HIGHEST for action port [ 688.520212] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da9c6c55-320d-4b40-84b2-934b0cfb4330 with Priority: HIGHEST for action port [ 688.520212] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-da9c6c55-320d-4b40-84b2-934b0cfb4330 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.520212] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da9c6c55-320d-4b40-84b2-934b0cfb4330" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.520600] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da9c6c55-320d-4b40-84b2-934b0cfb4330" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.521556] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da9c6c55-320d-4b40-84b2-934b0cfb4330" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.521556] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da9c6c55-320d-4b40-84b2-934b0cfb4330',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.651124] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c8026099-4b7a-433d-98f2-b33d3f0a6907',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.894976] env[68328]: INFO networking_nsxv3.common.synchronization [None req-f5ae834c-3892-4ed8-b32c-36fd5368ea3d tempest-ServerActionsTestJSON-719988657 tempest-ServerActionsTestJSON-719988657-project-member] Enqueued Resource ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 with Priority: HIGHEST for action security_group_rules [ 688.895726] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 with Priority: HIGHEST for action security_group_rules [ 688.895828] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8024e0cc-9eaa-4282-b00c-9e9b1de030e2 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.895957] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.896102] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.900995] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.900995] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8024e0cc-9eaa-4282-b00c-9e9b1de030e2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.959779] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3e399462-679e-43d6-8b03-2876938fc726',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.009018] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ba6f8661-b38c-4d97-a1c5-4a0e33e341bc: rpc.has_security_group_logging(os_id): False [ 689.030125] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port da9c6c55-320d-4b40-84b2-934b0cfb4330 [ 689.030125] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.030125] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.030125] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.030125] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.030361] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.030420] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:da9c6c55-320d-4b40-84b2-934b0cfb4330 already deleted. [ 689.030563] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da9c6c55-320d-4b40-84b2-934b0cfb4330" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.032345] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.032461] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.032528] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.032739] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.032820] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.032996] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.033219] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.033287] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.033650] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.033753] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.033945] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.034089] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.034153] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.034300] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.034370] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.035016] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.035016] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.035016] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.035016] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.035198] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.035198] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc is going to be updated. [ 689.095532] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.095664] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.095736] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.095972] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.096110] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.110643] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc in Status: IN_PROGRESS for 2s [ 689.118878] env[68328]: INFO networking_nsxv3.common.synchronization [None req-3fe5831e-46da-40fc-94ce-6010ee22e1e1 tempest-ServerActionsTestJSON-719988657 tempest-ServerActionsTestJSON-719988657-project-member] Enqueued Resource ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 with Priority: HIGHEST for action security_group_rules [ 689.119635] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 with Priority: HIGHEST for action security_group_rules [ 689.120195] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8024e0cc-9eaa-4282-b00c-9e9b1de030e2 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.120336] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.154454] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.154589] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.154589] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.154882] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.154882] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.154979] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8026099-4b7a-433d-98f2-b33d3f0a6907 is going to be created. [ 689.197893] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.198526] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.198875] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.200040] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.200040] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.217828] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8026099-4b7a-433d-98f2-b33d3f0a6907 in Status: UNINITIALIZED for 2s [ 689.393345] env[68328]: INFO networking_nsxv3.common.synchronization [None req-262248ee-9ce4-4ee4-a06f-d60236f4fe10 None None] Enqueued Resource ID: 334560dc-9bb9-48ab-9046-cb59c246ac10 with Priority: HIGHEST for action port [ 689.393345] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 334560dc-9bb9-48ab-9046-cb59c246ac10 with Priority: HIGHEST for action port [ 689.393345] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-334560dc-9bb9-48ab-9046-cb59c246ac10 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.393345] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-334560dc-9bb9-48ab-9046-cb59c246ac10" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.393884] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-334560dc-9bb9-48ab-9046-cb59c246ac10" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.394525] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-334560dc-9bb9-48ab-9046-cb59c246ac10" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.395086] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('334560dc-9bb9-48ab-9046-cb59c246ac10',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.430923] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.431111] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.431188] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.431396] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.431488] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.431595] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 already deleted. [ 689.431681] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.432131] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.432309] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.432505] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8024e0cc-9eaa-4282-b00c-9e9b1de030e2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.444303] env[68328]: INFO networking_nsxv3.common.synchronization [req-c18bb7dd-4ff3-4939-a649-72604f626d30 req-7007af57-ffd9-4ec8-abbf-bd545ee6c1a3 service nova] Enqueued Resource ID: 96047272-421b-4187-99a6-e18e4a01bfc9 with Priority: HIGHEST for action security_group_rules [ 689.444386] env[68328]: INFO networking_nsxv3.common.synchronization [req-c18bb7dd-4ff3-4939-a649-72604f626d30 req-7007af57-ffd9-4ec8-abbf-bd545ee6c1a3 service nova] Enqueued Resource ID: 96047272-421b-4187-99a6-e18e4a01bfc9 with Priority: HIGHEST for action security_group_members [ 689.444505] env[68328]: INFO networking_nsxv3.common.synchronization [req-c18bb7dd-4ff3-4939-a649-72604f626d30 req-7007af57-ffd9-4ec8-abbf-bd545ee6c1a3 service nova] Enqueued Resource ID: d3284395-bb78-4ab3-897b-e895f46a37c2 with Priority: HIGHEST for action port [ 689.444833] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96047272-421b-4187-99a6-e18e4a01bfc9 with Priority: HIGHEST for action security_group_rules [ 689.445258] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96047272-421b-4187-99a6-e18e4a01bfc9 with Priority: HIGHEST for action security_group_members [ 689.445465] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3284395-bb78-4ab3-897b-e895f46a37c2 with Priority: HIGHEST for action port [ 689.446271] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-96047272-421b-4187-99a6-e18e4a01bfc9 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.446765] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.447012] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.447783] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.447876] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('96047272-421b-4187-99a6-e18e4a01bfc9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.448763] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-96047272-421b-4187-99a6-e18e4a01bfc9 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.448865] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.448946] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.449112] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.450456] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.450588] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.450683] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.450842] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.450953] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.451613] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('96047272-421b-4187-99a6-e18e4a01bfc9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.452495] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3284395-bb78-4ab3-897b-e895f46a37c2 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.452642] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3284395-bb78-4ab3-897b-e895f46a37c2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.452704] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3284395-bb78-4ab3-897b-e895f46a37c2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.452806] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3284395-bb78-4ab3-897b-e895f46a37c2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.452946] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3284395-bb78-4ab3-897b-e895f46a37c2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.461267] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3e399462-679e-43d6-8b03-2876938fc726: rpc.has_security_group_logging(os_id): False [ 689.480328] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.480328] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.480328] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.480507] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.480507] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.480766] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.480886] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.481016] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.481136] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.481214] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.481806] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e399462-679e-43d6-8b03-2876938fc726 is going to be created. [ 689.538357] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.538588] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.538588] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.538818] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.542252] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.553103] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e399462-679e-43d6-8b03-2876938fc726 in Status: IN_PROGRESS for 2s [ 689.561109] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57b7bbe5-8e54-4d67-b8c6-8cfc418f7042 in Status: SUCCESS [ 689.561515] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57b7bbe5-8e54-4d67-b8c6-8cfc418f7042" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.827052] env[68328]: INFO networking_nsxv3.common.synchronization [req-c18bb7dd-4ff3-4939-a649-72604f626d30 req-60ac42cd-0b7a-41b7-bbaf-a95bee986d34 tempest-MultipleCreateTestJSON-885002055 tempest-MultipleCreateTestJSON-885002055-project-member] Enqueued Resource ID: 96047272-421b-4187-99a6-e18e4a01bfc9 with Priority: HIGHEST for action security_group_members [ 689.827052] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96047272-421b-4187-99a6-e18e4a01bfc9 with Priority: HIGHEST for action security_group_members [ 689.827052] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-96047272-421b-4187-99a6-e18e4a01bfc9 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.827052] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.897620] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 334560dc-9bb9-48ab-9046-cb59c246ac10 [ 689.898323] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.898615] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.898882] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.899268] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.899493] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.899716] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:334560dc-9bb9-48ab-9046-cb59c246ac10 already deleted. [ 689.900213] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-334560dc-9bb9-48ab-9046-cb59c246ac10" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.952637] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.952637] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.952637] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.952637] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.952637] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.952637] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 already deleted. [ 689.952637] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.958048] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('96047272-421b-4187-99a6-e18e4a01bfc9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.958048] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-96047272-421b-4187-99a6-e18e4a01bfc9 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.958048] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.958048] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d3284395-bb78-4ab3-897b-e895f46a37c2 with status ACTIVE [ 689.958048] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.958048] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.958048] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.958048] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.958048] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.958048] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.958048] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.958048] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.958048] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.958048] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.959057] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.959057] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.959057] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.959057] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.959057] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.959057] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d3284395-bb78-4ab3-897b-e895f46a37c2 is going to be updated. [ 689.962138] env[68328]: INFO networking_nsxv3.common.synchronization [req-25b4a6fd-fd12-49ff-a862-a52056e1c9a8 req-6f5d3634-c983-4aeb-90a6-edcebdcbe63e tempest-SecurityGroupRulesTestJSON-182117541 tempest-SecurityGroupRulesTestJSON-182117541-project-member] Enqueued Resource ID: 2cce6bb9-58c4-450a-9752-143e40b84f22 with Priority: HIGHEST for action security_group_rules [ 689.963389] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cce6bb9-58c4-450a-9752-143e40b84f22 with Priority: HIGHEST for action security_group_rules [ 689.964217] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2cce6bb9-58c4-450a-9752-143e40b84f22 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.964495] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2cce6bb9-58c4-450a-9752-143e40b84f22" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.964691] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2cce6bb9-58c4-450a-9752-143e40b84f22" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.965077] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2cce6bb9-58c4-450a-9752-143e40b84f22" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.965300] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2cce6bb9-58c4-450a-9752-143e40b84f22',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.979502] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.979502] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.979502] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.980177] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.981055] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.981055] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3284395-bb78-4ab3-897b-e895f46a37c2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.460932] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('96047272-421b-4187-99a6-e18e4a01bfc9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.489514] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.489992] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.489992] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.490210] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.490210] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.490365] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2cce6bb9-58c4-450a-9752-143e40b84f22 already deleted. [ 690.490365] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2cce6bb9-58c4-450a-9752-143e40b84f22" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.498587] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-133 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.498587] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-133" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.498587] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-133" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.500831] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-133" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.500831] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.502352] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.502352] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.502573] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.502753] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.503021] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 690.503209] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 690.503349] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 690.503468] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 690.503620] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 690.503750] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 690.503899] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 690.521922] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 690.522359] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 690.522453] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 690.522605] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-133" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.522955] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-a11c821b-df8d-40da-b842-a9b75f920d9f taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.523623] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-a11c821b-df8d-40da-b842-a9b75f920d9f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.523623] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-a11c821b-df8d-40da-b842-a9b75f920d9f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.523623] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-a11c821b-df8d-40da-b842-a9b75f920d9f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.523808] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a11c821b-df8d-40da-b842-a9b75f920d9f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.964187] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.968159] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.968159] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.968159] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.968159] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.968159] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96047272-421b-4187-99a6-e18e4a01bfc9 is going to be created. [ 690.993454] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.996049] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.996049] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.996049] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.996049] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.006484] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96047272-421b-4187-99a6-e18e4a01bfc9 in Status: UNINITIALIZED for 2s [ 691.028728] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.029011] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.029137] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.029466] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.029616] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.029766] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port a11c821b-df8d-40da-b842-a9b75f920d9f not found, creating... [ 691.030133] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.030377] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.030569] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.030905] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.031122] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.031435] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.032762] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.032762] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.032762] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.032762] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.032762] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: a11c821b-df8d-40da-b842-a9b75f920d9f is going to be created. [ 691.050567] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.050833] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.050957] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.052130] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.052378] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.052609] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-a11c821b-df8d-40da-b842-a9b75f920d9f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.129326] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc in Status: SUCCESS [ 691.129433] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.129629] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.129868] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.129969] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba6f8661-b38c-4d97-a1c5-4a0e33e341bc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.230410] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8026099-4b7a-433d-98f2-b33d3f0a6907 in Status: SUCCESS [ 691.230618] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8026099-4b7a-433d-98f2-b33d3f0a6907" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.231211] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8026099-4b7a-433d-98f2-b33d3f0a6907" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.231427] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8026099-4b7a-433d-98f2-b33d3f0a6907" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.231661] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.231738] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.231854] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.231942] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.234014] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.234014] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8026099-4b7a-433d-98f2-b33d3f0a6907" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.234014] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c8026099-4b7a-433d-98f2-b33d3f0a6907',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.573597] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e399462-679e-43d6-8b03-2876938fc726 in Status: SUCCESS [ 691.573597] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.634764] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.634925] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.634993] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.635269] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.635481] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.635566] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.635609] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.635754] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.635842] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.635932] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.636030] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ba6f8661-b38c-4d97-a1c5-4a0e33e341bc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.736472] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8026099-4b7a-433d-98f2-b33d3f0a6907 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.736657] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8026099-4b7a-433d-98f2-b33d3f0a6907" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.736731] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8026099-4b7a-433d-98f2-b33d3f0a6907" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.736967] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8026099-4b7a-433d-98f2-b33d3f0a6907" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.737176] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.737287] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.737347] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.737521] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.737614] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.738308] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8026099-4b7a-433d-98f2-b33d3f0a6907" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.738308] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8026099-4b7a-433d-98f2-b33d3f0a6907 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.738308] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8026099-4b7a-433d-98f2-b33d3f0a6907" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.738308] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8026099-4b7a-433d-98f2-b33d3f0a6907" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.738308] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8026099-4b7a-433d-98f2-b33d3f0a6907" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.738590] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.738590] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.738590] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.738883] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.738883] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.739012] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8026099-4b7a-433d-98f2-b33d3f0a6907" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.739710] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c8026099-4b7a-433d-98f2-b33d3f0a6907',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.769270] env[68328]: INFO networking_nsxv3.common.synchronization [None req-689079ed-648b-4d61-95e1-b1dc1e39c7e7 None None] Enqueued Resource ID: b9626ac6-d9fc-4b69-bd8a-a00cca207a66 with Priority: HIGHEST for action port [ 691.769780] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9626ac6-d9fc-4b69-bd8a-a00cca207a66 with Priority: HIGHEST for action port [ 691.770414] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9626ac6-d9fc-4b69-bd8a-a00cca207a66 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.770733] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9626ac6-d9fc-4b69-bd8a-a00cca207a66" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.770893] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9626ac6-d9fc-4b69-bd8a-a00cca207a66" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.771247] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9626ac6-d9fc-4b69-bd8a-a00cca207a66" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.771423] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9626ac6-d9fc-4b69-bd8a-a00cca207a66',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.139045] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.139045] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.139045] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.139306] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.139464] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.139616] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.139697] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.139895] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.139989] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.140108] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.140279] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.140374] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.140433] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.141201] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.141438] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.142217] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.142300] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.142448] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.142537] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.142625] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.142717] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ba6f8661-b38c-4d97-a1c5-4a0e33e341bc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.242969] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c8026099-4b7a-433d-98f2-b33d3f0a6907: rpc.has_security_group_logging(os_id): False [ 692.262391] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.262529] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.262598] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.262808] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.262925] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.263096] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.263192] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.263252] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.263408] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.263509] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.263739] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.263836] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.263896] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.264052] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.264148] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.264301] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.264821] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.264821] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.264821] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.266172] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.266172] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c8026099-4b7a-433d-98f2-b33d3f0a6907 is going to be created. [ 692.269010] env[68328]: INFO networking_nsxv3.common.synchronization [req-c18bb7dd-4ff3-4939-a649-72604f626d30 req-84caba10-1f34-469a-9c30-31d14eea859e service nova] Enqueued Resource ID: 96047272-421b-4187-99a6-e18e4a01bfc9 with Priority: HIGHEST for action security_group_rules [ 692.270559] env[68328]: INFO networking_nsxv3.common.synchronization [req-c18bb7dd-4ff3-4939-a649-72604f626d30 req-84caba10-1f34-469a-9c30-31d14eea859e service nova] Enqueued Resource ID: 96047272-421b-4187-99a6-e18e4a01bfc9 with Priority: HIGHEST for action security_group_members [ 692.270793] env[68328]: INFO networking_nsxv3.common.synchronization [req-c18bb7dd-4ff3-4939-a649-72604f626d30 req-84caba10-1f34-469a-9c30-31d14eea859e service nova] Enqueued Resource ID: a11c821b-df8d-40da-b842-a9b75f920d9f with Priority: HIGHEST for action port [ 692.271430] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96047272-421b-4187-99a6-e18e4a01bfc9 with Priority: HIGHEST for action security_group_rules [ 692.271567] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96047272-421b-4187-99a6-e18e4a01bfc9 with Priority: HIGHEST for action security_group_members [ 692.271663] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a11c821b-df8d-40da-b842-a9b75f920d9f with Priority: HIGHEST for action port [ 692.272337] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-96047272-421b-4187-99a6-e18e4a01bfc9 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.272544] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.272815] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-96047272-421b-4187-99a6-e18e4a01bfc9 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.272929] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.273874] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-a11c821b-df8d-40da-b842-a9b75f920d9f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.273984] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a11c821b-df8d-40da-b842-a9b75f920d9f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.276781] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a11c821b-df8d-40da-b842-a9b75f920d9f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.277038] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a11c821b-df8d-40da-b842-a9b75f920d9f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.277129] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a11c821b-df8d-40da-b842-a9b75f920d9f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.279252] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b9626ac6-d9fc-4b69-bd8a-a00cca207a66 [ 692.279252] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.279252] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.279252] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.279252] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.279252] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.279252] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b9626ac6-d9fc-4b69-bd8a-a00cca207a66 already deleted. [ 692.279252] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9626ac6-d9fc-4b69-bd8a-a00cca207a66" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.321710] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.321859] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.321930] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.322190] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.322374] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.334927] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c8026099-4b7a-433d-98f2-b33d3f0a6907 in Status: IN_PROGRESS for 2s [ 692.337210] env[68328]: INFO networking_nsxv3.common.synchronization [req-9e6f97e0-6528-4777-bb2c-1fb8c49eef7e req-7686d425-cb5c-4b4a-869b-ddf749eae39d tempest-SecurityGroupRulesTestJSON-182117541 tempest-SecurityGroupRulesTestJSON-182117541-project-member] Enqueued Resource ID: 2cce6bb9-58c4-450a-9752-143e40b84f22 with Priority: HIGHEST for action security_group_rules [ 692.340632] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cce6bb9-58c4-450a-9752-143e40b84f22 with Priority: HIGHEST for action security_group_rules [ 692.340632] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2cce6bb9-58c4-450a-9752-143e40b84f22 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.340632] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2cce6bb9-58c4-450a-9752-143e40b84f22" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.340632] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2cce6bb9-58c4-450a-9752-143e40b84f22" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.340632] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2cce6bb9-58c4-450a-9752-143e40b84f22" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.340632] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2cce6bb9-58c4-450a-9752-143e40b84f22',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.646620] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ba6f8661-b38c-4d97-a1c5-4a0e33e341bc: rpc.has_security_group_logging(os_id): False [ 692.664319] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.664319] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.664319] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.664511] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.664604] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.664810] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.664920] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.664972] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.665365] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.668542] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.668542] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.668542] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.668542] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.668542] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.668542] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.668542] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.668542] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.668542] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.668542] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.668542] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.668542] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc is going to be updated. [ 692.727417] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.727564] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.727736] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.727931] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.728110] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.743310] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc in Status: IN_PROGRESS for 2s [ 692.781609] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a11c821b-df8d-40da-b842-a9b75f920d9f with status ACTIVE [ 692.781963] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.782121] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.782191] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.782408] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.782548] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.782738] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.782936] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.782936] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.784241] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.784241] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.784241] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.784241] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.784421] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.784421] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.784492] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.785706] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a11c821b-df8d-40da-b842-a9b75f920d9f is going to be updated. [ 692.823076] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.824291] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.824291] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.824291] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.824291] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.824291] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a11c821b-df8d-40da-b842-a9b75f920d9f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.859573] env[68328]: INFO networking_nsxv3.common.synchronization [None req-2bd75b17-47cd-44eb-8e78-649794cda9eb tempest-ServersTestJSON-1500344576 tempest-ServersTestJSON-1500344576-project-member] Enqueued Resource ID: e6de510a-9045-41b5-b9c0-0c2740830426 with Priority: HIGHEST for action security_group_rules [ 692.861977] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6de510a-9045-41b5-b9c0-0c2740830426 with Priority: HIGHEST for action security_group_rules [ 692.861977] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6de510a-9045-41b5-b9c0-0c2740830426 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.862364] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6de510a-9045-41b5-b9c0-0c2740830426" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.862364] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6de510a-9045-41b5-b9c0-0c2740830426" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.863531] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6de510a-9045-41b5-b9c0-0c2740830426" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.863531] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6de510a-9045-41b5-b9c0-0c2740830426',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.870260] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.870392] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.870457] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.871482] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.871482] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.871482] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2cce6bb9-58c4-450a-9752-143e40b84f22 already deleted. [ 692.871482] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2cce6bb9-58c4-450a-9752-143e40b84f22" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.004255] env[68328]: INFO networking_nsxv3.common.synchronization [None req-de0ef847-adaf-444c-9820-97793ff7351e tempest-ServersTestJSON-1500344576 tempest-ServersTestJSON-1500344576-project-member] Enqueued Resource ID: e6de510a-9045-41b5-b9c0-0c2740830426 with Priority: HIGHEST for action security_group_rules [ 693.004989] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6de510a-9045-41b5-b9c0-0c2740830426 with Priority: HIGHEST for action security_group_rules [ 693.004989] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6de510a-9045-41b5-b9c0-0c2740830426 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.004989] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6de510a-9045-41b5-b9c0-0c2740830426" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.019089] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96047272-421b-4187-99a6-e18e4a01bfc9 in Status: SUCCESS [ 693.019089] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.019089] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.019089] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.019089] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.019846] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.019846] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.019846] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.019846] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.019846] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('96047272-421b-4187-99a6-e18e4a01bfc9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.384347] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.384347] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.384347] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.384347] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.384347] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.384347] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6de510a-9045-41b5-b9c0-0c2740830426 already deleted. [ 693.384347] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6de510a-9045-41b5-b9c0-0c2740830426" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.384347] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6de510a-9045-41b5-b9c0-0c2740830426" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.384347] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6de510a-9045-41b5-b9c0-0c2740830426" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.384347] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6de510a-9045-41b5-b9c0-0c2740830426',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.523929] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('96047272-421b-4187-99a6-e18e4a01bfc9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.905651] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.905956] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.905956] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.906310] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.906392] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.906473] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6de510a-9045-41b5-b9c0-0c2740830426 already deleted. [ 693.906638] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6de510a-9045-41b5-b9c0-0c2740830426" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.029472] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('96047272-421b-4187-99a6-e18e4a01bfc9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.349375] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c8026099-4b7a-433d-98f2-b33d3f0a6907 in Status: SUCCESS [ 694.350297] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c8026099-4b7a-433d-98f2-b33d3f0a6907" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.533166] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.533664] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.534128] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.537018] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.537018] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.537018] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96047272-421b-4187-99a6-e18e4a01bfc9 is going to be updated. [ 694.562790] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.565183] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.565183] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.565183] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.565183] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.575551] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96047272-421b-4187-99a6-e18e4a01bfc9 in Status: IN_PROGRESS for 2s [ 694.761143] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc in Status: SUCCESS [ 694.761287] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.207861] env[68328]: INFO networking_nsxv3.common.synchronization [None req-bde5aca1-f8e7-4a9d-afb0-6ff38b24aeb4 None None] Enqueued Resource ID: 98c839f9-0e64-44dc-9541-35449f06c146 with Priority: HIGHEST for action port [ 695.208177] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98c839f9-0e64-44dc-9541-35449f06c146 with Priority: HIGHEST for action port [ 695.211345] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-98c839f9-0e64-44dc-9541-35449f06c146 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.211538] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98c839f9-0e64-44dc-9541-35449f06c146" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.211639] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98c839f9-0e64-44dc-9541-35449f06c146" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.211898] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98c839f9-0e64-44dc-9541-35449f06c146" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.212073] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98c839f9-0e64-44dc-9541-35449f06c146',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.328134] env[68328]: INFO networking_nsxv3.common.synchronization [req-db814247-2375-4ee3-a3f8-25c908c9875f req-4e876b15-38a5-47e0-8b94-30559e22b13a tempest-ImagesOneServerTestJSON-1899488142 tempest-ImagesOneServerTestJSON-1899488142-project-member] Enqueued Resource ID: 7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63 with Priority: HIGHEST for action security_group_members [ 695.329530] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63 with Priority: HIGHEST for action security_group_members [ 695.330763] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.331105] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.331105] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.331300] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.331487] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.331886] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.331999] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.332784] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.332784] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.332784] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.715209] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 98c839f9-0e64-44dc-9541-35449f06c146 [ 695.716406] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.716406] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.716406] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.716406] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.716406] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.716406] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:98c839f9-0e64-44dc-9541-35449f06c146 already deleted. [ 695.716406] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98c839f9-0e64-44dc-9541-35449f06c146" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.734566] env[68328]: INFO networking_nsxv3.common.synchronization [req-2036d1fa-8d98-40bc-bcc6-e6e3f0b16f84 req-9a01c06e-fc35-41fd-af75-9dc79ffdb76d tempest-ServerDiagnosticsTest-2048554781 tempest-ServerDiagnosticsTest-2048554781-project-member] Enqueued Resource ID: b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38 with Priority: HIGHEST for action security_group_members [ 695.735131] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38 with Priority: HIGHEST for action security_group_members [ 695.736062] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.736181] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.736252] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.736458] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.736624] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.736739] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.736789] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.736958] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.737061] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.737154] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.834038] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.834192] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.834270] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.834474] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.834582] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.834759] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.835256] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.835256] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.835256] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.836022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.836106] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63 already deleted. [ 695.836177] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.865787] env[68328]: INFO networking_nsxv3.common.synchronization [req-f44d894b-18e5-45f5-8a94-7cf5f3464ee9 req-b9947d70-5fdb-4a95-8f51-05c46032f873 tempest-ServerExternalEventsTest-773432568 tempest-ServerExternalEventsTest-773432568-project-member] Enqueued Resource ID: 8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b with Priority: HIGHEST for action security_group_members [ 695.866889] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b with Priority: HIGHEST for action security_group_members [ 695.868749] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.868976] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.868976] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.869377] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.869377] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.869496] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.869534] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.870722] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.870825] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.870929] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.916489] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-29 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.916744] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-29" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.916896] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-29" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.917501] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-29" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.917607] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.917821] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.917897] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.918250] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.918544] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.918661] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 695.918811] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 695.918948] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 695.919099] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 695.919221] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 695.919331] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 695.919533] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 695.937705] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 695.937895] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 695.938063] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 695.938278] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-29" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.938603] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-c5ae7014-2db8-41bd-a890-a3eb385ad704 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.938822] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-c5ae7014-2db8-41bd-a890-a3eb385ad704" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.938973] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-c5ae7014-2db8-41bd-a890-a3eb385ad704" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.939315] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-c5ae7014-2db8-41bd-a890-a3eb385ad704" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.939460] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5ae7014-2db8-41bd-a890-a3eb385ad704',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.240143] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.240444] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.240444] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.240577] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.240672] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.240866] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.240964] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.241035] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.241188] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.241264] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.241393] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38 is going to be updated. [ 696.265823] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.266024] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.266078] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.266277] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.266423] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.274725] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38 in Status: IN_PROGRESS for 2s [ 696.334286] env[68328]: INFO networking_nsxv3.common.synchronization [req-c467b2a7-6a92-4ab1-88c7-c943a9884dd2 req-35ad3ac5-6b2a-47a5-9075-b524b9402295 tempest-SecurityGroupRulesTestJSON-182117541 tempest-SecurityGroupRulesTestJSON-182117541-project-member] Enqueued Resource ID: 2cce6bb9-58c4-450a-9752-143e40b84f22 with Priority: HIGHEST for action security_group_rules [ 696.334286] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cce6bb9-58c4-450a-9752-143e40b84f22 with Priority: HIGHEST for action security_group_rules [ 696.334286] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2cce6bb9-58c4-450a-9752-143e40b84f22 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.334286] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2cce6bb9-58c4-450a-9752-143e40b84f22" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.334286] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2cce6bb9-58c4-450a-9752-143e40b84f22" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.335273] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2cce6bb9-58c4-450a-9752-143e40b84f22" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.335273] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2cce6bb9-58c4-450a-9752-143e40b84f22',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.375887] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.376082] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.376127] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.376344] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.376433] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.376649] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.376751] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.376842] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.377034] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.377112] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.377218] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b is going to be updated. [ 696.404869] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.405074] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.405167] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.405367] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.405506] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.413573] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b in Status: IN_PROGRESS for 2s [ 696.445064] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.446011] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.446011] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.446011] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.446011] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.446344] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port c5ae7014-2db8-41bd-a890-a3eb385ad704 not found, creating... [ 696.446344] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.446562] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.446634] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.446846] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.447055] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.447314] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.447468] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.447582] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.447792] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.447924] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.448073] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: c5ae7014-2db8-41bd-a890-a3eb385ad704 is going to be created. [ 696.466872] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.466872] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.467061] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.467331] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.467561] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.468170] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-c5ae7014-2db8-41bd-a890-a3eb385ad704" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.586899] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96047272-421b-4187-99a6-e18e4a01bfc9 in Status: SUCCESS [ 696.586899] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.586899] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.586899] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.586899] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.586899] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.586899] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.586899] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.586899] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.586899] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.586899] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('96047272-421b-4187-99a6-e18e4a01bfc9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.589374] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.589374] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.589374] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.589374] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.589374] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.589374] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.589374] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.589374] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('96047272-421b-4187-99a6-e18e4a01bfc9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.854077] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.854248] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.854288] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.854516] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.854604] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.854689] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2cce6bb9-58c4-450a-9752-143e40b84f22 already deleted. [ 696.854773] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2cce6bb9-58c4-450a-9752-143e40b84f22" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.088727] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-96047272-421b-4187-99a6-e18e4a01bfc9 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.089058] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.095575] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('96047272-421b-4187-99a6-e18e4a01bfc9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.466522] env[68328]: INFO networking_nsxv3.common.synchronization [req-db814247-2375-4ee3-a3f8-25c908c9875f req-13ae77e1-44bf-4e02-9a4c-98eaadd595f5 service nova] Enqueued Resource ID: 7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63 with Priority: HIGHEST for action security_group_rules [ 697.466522] env[68328]: INFO networking_nsxv3.common.synchronization [req-db814247-2375-4ee3-a3f8-25c908c9875f req-13ae77e1-44bf-4e02-9a4c-98eaadd595f5 service nova] Enqueued Resource ID: 7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63 with Priority: HIGHEST for action security_group_members [ 697.466522] env[68328]: INFO networking_nsxv3.common.synchronization [req-db814247-2375-4ee3-a3f8-25c908c9875f req-13ae77e1-44bf-4e02-9a4c-98eaadd595f5 service nova] Enqueued Resource ID: c5ae7014-2db8-41bd-a890-a3eb385ad704 with Priority: HIGHEST for action port [ 697.467061] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63 with Priority: HIGHEST for action security_group_rules [ 697.467061] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63 with Priority: HIGHEST for action security_group_members [ 697.467061] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5ae7014-2db8-41bd-a890-a3eb385ad704 with Priority: HIGHEST for action port [ 697.468411] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.468411] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.468411] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.468411] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.468411] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.469139] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.469195] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.469234] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.470034] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.470034] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.470034] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.470034] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.470034] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.470034] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.470299] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.471040] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5ae7014-2db8-41bd-a890-a3eb385ad704 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.471611] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5ae7014-2db8-41bd-a890-a3eb385ad704" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.471611] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5ae7014-2db8-41bd-a890-a3eb385ad704" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.471611] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5ae7014-2db8-41bd-a890-a3eb385ad704" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.471611] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5ae7014-2db8-41bd-a890-a3eb385ad704',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.598760] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('96047272-421b-4187-99a6-e18e4a01bfc9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.714872] env[68328]: INFO networking_nsxv3.common.synchronization [req-b110a4b8-c38d-428e-b07d-0bdb28c37e8a req-1f427a59-0153-497c-b51d-6b18f600f53c tempest-ServersAdminNegativeTestJSON-100889397 tempest-ServersAdminNegativeTestJSON-100889397-project-member] Enqueued Resource ID: 55dff300-131a-42f9-920d-f2b5a3b91449 with Priority: HIGHEST for action security_group_members [ 697.715553] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55dff300-131a-42f9-920d-f2b5a3b91449 with Priority: HIGHEST for action security_group_members [ 697.715814] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-55dff300-131a-42f9-920d-f2b5a3b91449 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.715884] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.715955] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.716534] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.716824] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.716962] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.717071] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.717259] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.717388] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.717508] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55dff300-131a-42f9-920d-f2b5a3b91449',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.771785] env[68328]: INFO networking_nsxv3.common.synchronization [None req-1ccfafa6-66f2-4591-ab61-db1ee0bbb788 None None] Enqueued Resource ID: 7e8c311b-719c-42a0-b81d-87ead9a67b22 with Priority: HIGHEST for action port [ 697.772075] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e8c311b-719c-42a0-b81d-87ead9a67b22 with Priority: HIGHEST for action port [ 697.772388] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e8c311b-719c-42a0-b81d-87ead9a67b22 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.773698] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e8c311b-719c-42a0-b81d-87ead9a67b22" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.773698] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e8c311b-719c-42a0-b81d-87ead9a67b22" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.773698] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e8c311b-719c-42a0-b81d-87ead9a67b22" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.773698] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e8c311b-719c-42a0-b81d-87ead9a67b22',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.977342] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.977342] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.977342] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.977771] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c5ae7014-2db8-41bd-a890-a3eb385ad704 with status ACTIVE [ 697.977771] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.977771] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.977771] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.977978] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.978091] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.978271] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.978366] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.978424] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.978579] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.980649] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.980861] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.980964] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.981039] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.981223] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.981303] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.982116] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c5ae7014-2db8-41bd-a890-a3eb385ad704 is going to be updated. [ 698.006561] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.006736] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.006812] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.007067] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.007207] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.007432] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5ae7014-2db8-41bd-a890-a3eb385ad704" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.036127] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-739 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.036127] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-739" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.036905] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-739" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.036905] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-739" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.037012] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.037188] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.037308] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.037546] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.037691] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.041025] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 698.041025] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 698.041025] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 698.041025] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 698.041025] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 698.041025] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 698.041025] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 698.058092] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 698.058490] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 698.058642] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 698.060142] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-739" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.060142] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-caacfbfc-c879-4b24-8477-31795ea8b850 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.060142] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-caacfbfc-c879-4b24-8477-31795ea8b850" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.060142] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-caacfbfc-c879-4b24-8477-31795ea8b850" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.060543] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-caacfbfc-c879-4b24-8477-31795ea8b850" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.060815] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('caacfbfc-c879-4b24-8477-31795ea8b850',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.101488] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.101973] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.102161] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.102648] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.102767] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.102871] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96047272-421b-4187-99a6-e18e4a01bfc9 is going to be updated. [ 698.132735] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.133476] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.133607] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.133873] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.134490] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.148130] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96047272-421b-4187-99a6-e18e4a01bfc9 in Status: IN_PROGRESS for 2s [ 698.220076] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55dff300-131a-42f9-920d-f2b5a3b91449',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.276968] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7e8c311b-719c-42a0-b81d-87ead9a67b22 [ 698.277228] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.277351] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.277434] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.277694] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.277795] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.277892] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7e8c311b-719c-42a0-b81d-87ead9a67b22 already deleted. [ 698.277966] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e8c311b-719c-42a0-b81d-87ead9a67b22" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.287568] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38 in Status: SUCCESS [ 698.287766] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38 deletion is rescheduled due to dependency. [ 698.287881] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.421742] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b in Status: SUCCESS [ 698.421965] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b deletion is rescheduled due to dependency. [ 698.422155] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.489053] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.565914] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.566879] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.567700] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.568141] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.568486] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.572019] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port caacfbfc-c879-4b24-8477-31795ea8b850 not found, creating... [ 698.572019] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.572019] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.572019] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.572019] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.572019] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.572019] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.572019] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.572019] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.572019] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.572527] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.572527] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: caacfbfc-c879-4b24-8477-31795ea8b850 is going to be created. [ 698.592078] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.593253] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.593655] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.594052] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.594404] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.594769] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-caacfbfc-c879-4b24-8477-31795ea8b850" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.725348] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55dff300-131a-42f9-920d-f2b5a3b91449',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.795383] env[68328]: INFO networking_nsxv3.common.synchronization [None req-18179b86-b953-407b-9d75-76cb42ba7917 tempest-AttachInterfacesUnderV243Test-835992920 tempest-AttachInterfacesUnderV243Test-835992920-project-member] Enqueued Resource ID: 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 with Priority: HIGHEST for action security_group_rules [ 698.795383] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 with Priority: HIGHEST for action security_group_rules [ 698.795383] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.795383] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.795383] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.795383] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.796387] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2158d2f5-a6e7-415a-a8b1-6f8353f45cb8',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.881939] env[68328]: INFO networking_nsxv3.common.synchronization [None req-9fd10a9a-159a-4c93-b989-dafbc078dedc tempest-AttachInterfacesUnderV243Test-835992920 tempest-AttachInterfacesUnderV243Test-835992920-project-member] Enqueued Resource ID: 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 with Priority: HIGHEST for action security_group_rules [ 698.881939] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 with Priority: HIGHEST for action security_group_rules [ 698.881939] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.881939] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.990889] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.993471] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.993471] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.993471] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.993471] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.993471] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63 is going to be created. [ 699.013493] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.015795] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.015795] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.015795] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.015795] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.024727] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63 in Status: UNINITIALIZED for 2s [ 699.232361] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.232609] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.232609] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.232797] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.232888] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.232994] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55dff300-131a-42f9-920d-f2b5a3b91449 is going to be updated. [ 699.273458] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.273692] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.273692] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.273921] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.276156] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.286908] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55dff300-131a-42f9-920d-f2b5a3b91449 in Status: IN_PROGRESS for 2s [ 699.320951] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.321708] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.321864] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.322190] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.322516] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.322641] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 already deleted. [ 699.322741] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.322909] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.323122] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.323209] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2158d2f5-a6e7-415a-a8b1-6f8353f45cb8',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.362833] env[68328]: INFO networking_nsxv3.common.synchronization [req-b650fbe6-4c5c-4aa3-9811-46e81165c8e0 req-5ecaa347-e5a9-4438-a3de-00395ec16395 tempest-TenantUsagesTestJSON-563650200 tempest-TenantUsagesTestJSON-563650200-project-member] Enqueued Resource ID: 72ca69cd-fcd9-4815-b331-9858d9cfad42 with Priority: HIGHEST for action security_group_members [ 699.363086] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72ca69cd-fcd9-4815-b331-9858d9cfad42 with Priority: HIGHEST for action security_group_members [ 699.363559] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-72ca69cd-fcd9-4815-b331-9858d9cfad42 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.364055] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72ca69cd-fcd9-4815-b331-9858d9cfad42" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.364055] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72ca69cd-fcd9-4815-b331-9858d9cfad42" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.364281] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72ca69cd-fcd9-4815-b331-9858d9cfad42" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.364447] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.365009] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.365113] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.365307] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.365400] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.365498] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72ca69cd-fcd9-4815-b331-9858d9cfad42',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.756323] env[68328]: INFO networking_nsxv3.common.synchronization [req-b110a4b8-c38d-428e-b07d-0bdb28c37e8a req-0dbf9f84-5335-4bbf-9d84-a407065c11eb service nova] Enqueued Resource ID: 55dff300-131a-42f9-920d-f2b5a3b91449 with Priority: HIGHEST for action security_group_rules [ 699.756323] env[68328]: INFO networking_nsxv3.common.synchronization [req-b110a4b8-c38d-428e-b07d-0bdb28c37e8a req-0dbf9f84-5335-4bbf-9d84-a407065c11eb service nova] Enqueued Resource ID: 55dff300-131a-42f9-920d-f2b5a3b91449 with Priority: HIGHEST for action security_group_members [ 699.756323] env[68328]: INFO networking_nsxv3.common.synchronization [req-b110a4b8-c38d-428e-b07d-0bdb28c37e8a req-0dbf9f84-5335-4bbf-9d84-a407065c11eb service nova] Enqueued Resource ID: caacfbfc-c879-4b24-8477-31795ea8b850 with Priority: HIGHEST for action port [ 699.757512] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55dff300-131a-42f9-920d-f2b5a3b91449 with Priority: HIGHEST for action security_group_rules [ 699.757791] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55dff300-131a-42f9-920d-f2b5a3b91449 with Priority: HIGHEST for action security_group_members [ 699.757924] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: caacfbfc-c879-4b24-8477-31795ea8b850 with Priority: HIGHEST for action port [ 699.758673] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55dff300-131a-42f9-920d-f2b5a3b91449 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.759146] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.759146] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.759280] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.759317] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55dff300-131a-42f9-920d-f2b5a3b91449',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.760387] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-55dff300-131a-42f9-920d-f2b5a3b91449 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.760549] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.760877] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-caacfbfc-c879-4b24-8477-31795ea8b850 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.762246] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-caacfbfc-c879-4b24-8477-31795ea8b850" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.762246] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-caacfbfc-c879-4b24-8477-31795ea8b850" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.762246] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-caacfbfc-c879-4b24-8477-31795ea8b850" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.762477] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('caacfbfc-c879-4b24-8477-31795ea8b850',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.847294] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.847294] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.847294] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.847294] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.847294] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.847294] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 already deleted. [ 699.847294] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.869797] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.870081] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.870539] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.870809] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.870934] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.871209] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.871356] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.871449] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.872105] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.872105] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.872105] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72ca69cd-fcd9-4815-b331-9858d9cfad42 is going to be updated. [ 699.895839] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.896014] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.896063] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.896274] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.896414] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.904950] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72ca69cd-fcd9-4815-b331-9858d9cfad42 in Status: IN_PROGRESS for 2s [ 700.159635] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96047272-421b-4187-99a6-e18e4a01bfc9 in Status: SUCCESS [ 700.160048] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.160238] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.164133] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.164133] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.164263] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.164320] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.164483] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.164570] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.164659] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.164819] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-96047272-421b-4187-99a6-e18e4a01bfc9 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.164915] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.165032] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.168175] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.168799] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.168799] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.168799] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.168799] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.170161] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.170308] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.170540] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('96047272-421b-4187-99a6-e18e4a01bfc9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.264474] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-55dff300-131a-42f9-920d-f2b5a3b91449 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.264671] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.264927] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port caacfbfc-c879-4b24-8477-31795ea8b850 with status ACTIVE [ 700.265174] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.265557] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.266907] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.266907] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.267072] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.267286] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.267420] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.267514] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.267724] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.267840] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.268064] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.271185] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.271299] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.271830] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.271830] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.271830] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: caacfbfc-c879-4b24-8477-31795ea8b850 is going to be updated. [ 700.291615] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.291834] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.291834] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.292086] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.292223] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.292397] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-caacfbfc-c879-4b24-8477-31795ea8b850" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.299958] env[68328]: INFO networking_nsxv3.common.synchronization [req-8b5cce98-cde8-4193-b319-113f9329c2d7 req-02edb0f3-add8-4f01-9935-f234944ce7bc tempest-ServersTestBootFromVolume-1101005300 tempest-ServersTestBootFromVolume-1101005300-project-member] Enqueued Resource ID: 6e39d3b8-c430-4219-9295-992b699ce546 with Priority: HIGHEST for action security_group_members [ 700.300499] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e39d3b8-c430-4219-9295-992b699ce546 with Priority: HIGHEST for action security_group_members [ 700.300799] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e39d3b8-c430-4219-9295-992b699ce546 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.300917] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e39d3b8-c430-4219-9295-992b699ce546" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.300985] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e39d3b8-c430-4219-9295-992b699ce546" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.301250] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e39d3b8-c430-4219-9295-992b699ce546" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.301427] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.301570] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.301618] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.301732] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.301820] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.301929] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e39d3b8-c430-4219-9295-992b699ce546',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.667097] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-803 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.667243] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-803" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.667408] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-803" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.667688] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-803" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.667969] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.668156] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.669607] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.669607] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.669607] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.669607] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 700.669607] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 700.669607] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 700.669607] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 700.669607] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 700.669607] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 700.669955] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 700.676400] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 96047272-421b-4187-99a6-e18e4a01bfc9: rpc.has_security_group_logging(os_id): False [ 700.692256] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 700.692403] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 700.692567] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 700.692812] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-803" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.693196] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-4456a260-9454-4ad9-afad-53c55f939e87 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.693592] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-4456a260-9454-4ad9-afad-53c55f939e87" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.693592] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-4456a260-9454-4ad9-afad-53c55f939e87" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.693809] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-4456a260-9454-4ad9-afad-53c55f939e87" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.695737] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4456a260-9454-4ad9-afad-53c55f939e87',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.696311] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.696461] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.696516] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.696712] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.696781] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.697021] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.697165] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.697200] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.697395] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.697432] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.697606] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.697693] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.697751] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.697896] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.697961] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.698170] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.698317] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.698441] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.698744] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.698744] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.698953] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 96047272-421b-4187-99a6-e18e4a01bfc9 is going to be created. [ 700.769608] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.769997] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.769997] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.772337] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.772337] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.782441] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 96047272-421b-4187-99a6-e18e4a01bfc9 in Status: IN_PROGRESS for 2s [ 700.805035] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.805035] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.805210] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.806585] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.806732] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.807346] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.807515] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.807585] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.807833] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.807955] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.808100] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e39d3b8-c430-4219-9295-992b699ce546 already deleted. [ 700.808198] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e39d3b8-c430-4219-9295-992b699ce546" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.034049] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63 in Status: SUCCESS [ 701.034304] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.034608] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.034733] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.034856] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.034978] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.035053] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.035214] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.035285] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.035396] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.035459] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.201230] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.201463] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.201599] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.201900] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.202071] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.202233] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 4456a260-9454-4ad9-afad-53c55f939e87 not found, creating... [ 701.202491] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.202650] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.202768] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.203056] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.203208] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.203490] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.203645] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.203765] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.203974] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.207702] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.208806] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 4456a260-9454-4ad9-afad-53c55f939e87 is going to be created. [ 701.231291] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.231589] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.231717] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.232139] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.232414] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.232657] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-4456a260-9454-4ad9-afad-53c55f939e87" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.296945] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55dff300-131a-42f9-920d-f2b5a3b91449 in Status: SUCCESS [ 701.297178] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.297350] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.297566] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.297748] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.297873] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.297937] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.298102] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.298180] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.298274] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55dff300-131a-42f9-920d-f2b5a3b91449',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.538739] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.538955] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.539068] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.539536] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.539536] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.539737] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.539737] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.539864] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.539938] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.539999] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.540775] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.540775] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.540775] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.540775] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.540775] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.540775] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.540775] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.541944] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.541944] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.541944] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.541944] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.802144] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55dff300-131a-42f9-920d-f2b5a3b91449',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.916249] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72ca69cd-fcd9-4815-b331-9858d9cfad42 in Status: SUCCESS [ 701.916394] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72ca69cd-fcd9-4815-b331-9858d9cfad42 deletion is rescheduled due to dependency. [ 701.916608] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72ca69cd-fcd9-4815-b331-9858d9cfad42" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.044693] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63: rpc.has_security_group_logging(os_id): False [ 702.063060] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.063837] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.063837] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.065041] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.065041] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.065041] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.065041] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.065354] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.065354] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.065491] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.065644] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.065756] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.065818] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.065987] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.066082] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.066390] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.066390] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.066511] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.066610] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.066705] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.066912] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63 is going to be created. [ 702.120373] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.120501] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.120687] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.120746] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.120932] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.134349] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63 in Status: IN_PROGRESS for 2s [ 702.231638] env[68328]: INFO networking_nsxv3.common.synchronization [req-8b5cce98-cde8-4193-b319-113f9329c2d7 req-c8b2a347-6cd0-4881-a446-0b01b2404fae service nova] Enqueued Resource ID: 6e39d3b8-c430-4219-9295-992b699ce546 with Priority: HIGHEST for action security_group_rules [ 702.231818] env[68328]: INFO networking_nsxv3.common.synchronization [req-8b5cce98-cde8-4193-b319-113f9329c2d7 req-c8b2a347-6cd0-4881-a446-0b01b2404fae service nova] Enqueued Resource ID: 6e39d3b8-c430-4219-9295-992b699ce546 with Priority: HIGHEST for action security_group_members [ 702.231956] env[68328]: INFO networking_nsxv3.common.synchronization [req-8b5cce98-cde8-4193-b319-113f9329c2d7 req-c8b2a347-6cd0-4881-a446-0b01b2404fae service nova] Enqueued Resource ID: 4456a260-9454-4ad9-afad-53c55f939e87 with Priority: HIGHEST for action port [ 702.232585] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e39d3b8-c430-4219-9295-992b699ce546 with Priority: HIGHEST for action security_group_rules [ 702.232740] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e39d3b8-c430-4219-9295-992b699ce546 with Priority: HIGHEST for action security_group_members [ 702.232842] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4456a260-9454-4ad9-afad-53c55f939e87 with Priority: HIGHEST for action port [ 702.233374] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e39d3b8-c430-4219-9295-992b699ce546 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.233737] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e39d3b8-c430-4219-9295-992b699ce546" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.233829] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e39d3b8-c430-4219-9295-992b699ce546" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.234126] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e39d3b8-c430-4219-9295-992b699ce546" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.234215] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e39d3b8-c430-4219-9295-992b699ce546',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.235668] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e39d3b8-c430-4219-9295-992b699ce546 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.235806] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e39d3b8-c430-4219-9295-992b699ce546" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.235876] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e39d3b8-c430-4219-9295-992b699ce546" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.236067] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e39d3b8-c430-4219-9295-992b699ce546" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.236232] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.236436] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.236436] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.236694] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.236922] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.236989] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e39d3b8-c430-4219-9295-992b699ce546',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.239473] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-4456a260-9454-4ad9-afad-53c55f939e87 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.239473] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4456a260-9454-4ad9-afad-53c55f939e87" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.239473] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4456a260-9454-4ad9-afad-53c55f939e87" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.239473] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4456a260-9454-4ad9-afad-53c55f939e87" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.239473] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4456a260-9454-4ad9-afad-53c55f939e87',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.310746] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55dff300-131a-42f9-920d-f2b5a3b91449',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.741112] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e39d3b8-c430-4219-9295-992b699ce546 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.741355] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e39d3b8-c430-4219-9295-992b699ce546" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.741552] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e39d3b8-c430-4219-9295-992b699ce546',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.742529] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4456a260-9454-4ad9-afad-53c55f939e87 with status ACTIVE [ 702.742735] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.742833] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.742900] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.743122] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.743212] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.743433] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.743569] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.743628] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.743916] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.744052] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.744309] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.744423] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.744495] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.744645] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.744721] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.744808] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4456a260-9454-4ad9-afad-53c55f939e87 is going to be updated. [ 702.763818] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.764029] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.764083] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.764256] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.764413] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.764949] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4456a260-9454-4ad9-afad-53c55f939e87" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.799067] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 96047272-421b-4187-99a6-e18e4a01bfc9 in Status: SUCCESS [ 702.799389] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.799664] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.799767] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.799865] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('96047272-421b-4187-99a6-e18e4a01bfc9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.813416] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.813738] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.813738] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.813892] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.813945] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.814111] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55dff300-131a-42f9-920d-f2b5a3b91449 is going to be updated. [ 702.856887] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.856887] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.856887] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.856887] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.856887] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.864728] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55dff300-131a-42f9-920d-f2b5a3b91449 in Status: IN_PROGRESS for 2s [ 703.248412] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e39d3b8-c430-4219-9295-992b699ce546',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.302409] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-96047272-421b-4187-99a6-e18e4a01bfc9 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.303511] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.303667] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.303983] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.304246] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.304426] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.304426] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.304575] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.304663] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.304827] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.304864] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('96047272-421b-4187-99a6-e18e4a01bfc9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.373134] env[68328]: INFO networking_nsxv3.common.synchronization [req-08b1bb54-c0a5-405c-b6c5-de6b3099be62 req-73e2cfdc-bcd4-462f-8e7a-4af0e2ce6045 tempest-ServersTestMultiNic-360170984 tempest-ServersTestMultiNic-360170984-project-member] Enqueued Resource ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc with Priority: HIGHEST for action security_group_members [ 703.373672] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc with Priority: HIGHEST for action security_group_members [ 703.373976] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.374122] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.374219] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.374392] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.374936] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.374936] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.374936] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.374936] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.374936] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.376196] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba6f8661-b38c-4d97-a1c5-4a0e33e341bc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.707763] env[68328]: INFO networking_nsxv3.common.synchronization [req-a8a5eee4-5c23-47d7-930a-58c90b1106d0 req-e6da59d0-47e7-493d-8193-8819b5746152 tempest-ServersTestManualDisk-40743403 tempest-ServersTestManualDisk-40743403-project-member] Enqueued Resource ID: 3826a056-9a94-48ea-97d8-49b840d3fb63 with Priority: HIGHEST for action security_group_members [ 703.709482] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3826a056-9a94-48ea-97d8-49b840d3fb63 with Priority: HIGHEST for action security_group_members [ 703.709973] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-3826a056-9a94-48ea-97d8-49b840d3fb63 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.710336] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3826a056-9a94-48ea-97d8-49b840d3fb63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.710336] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3826a056-9a94-48ea-97d8-49b840d3fb63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.710570] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3826a056-9a94-48ea-97d8-49b840d3fb63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.710769] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.710883] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.710948] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.711129] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.711221] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.711314] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3826a056-9a94-48ea-97d8-49b840d3fb63',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.751075] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.751302] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.751391] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.751601] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.751683] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.751796] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e39d3b8-c430-4219-9295-992b699ce546 is going to be created. [ 703.776594] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.776594] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.776594] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.776594] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.776594] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.783044] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e39d3b8-c430-4219-9295-992b699ce546 in Status: UNINITIALIZED for 2s [ 703.808118] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-96047272-421b-4187-99a6-e18e4a01bfc9 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.808305] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.808364] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.808784] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.809096] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.809480] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.809565] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.809750] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.809881] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.810508] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.810740] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-96047272-421b-4187-99a6-e18e4a01bfc9 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.810939] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.811147] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.811334] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.811485] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.811585] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.811692] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.811792] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.811878] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.811961] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.812128] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('96047272-421b-4187-99a6-e18e4a01bfc9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.878923] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ba6f8661-b38c-4d97-a1c5-4a0e33e341bc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.147434] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63 in Status: SUCCESS [ 704.147685] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.214041] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.214212] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.214343] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.214477] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.214564] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.214903] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.215043] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.215114] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.215291] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.215376] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.215469] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3826a056-9a94-48ea-97d8-49b840d3fb63 already deleted. [ 704.215551] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3826a056-9a94-48ea-97d8-49b840d3fb63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.235377] env[68328]: INFO networking_nsxv3.common.synchronization [req-08b1bb54-c0a5-405c-b6c5-de6b3099be62 req-062442bc-f663-4b10-96d6-7cf43f28509a tempest-ServersTestMultiNic-360170984 tempest-ServersTestMultiNic-360170984-project-member] Enqueued Resource ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc with Priority: HIGHEST for action security_group_members [ 704.235919] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc with Priority: HIGHEST for action security_group_members [ 704.236254] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.236355] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.314809] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 96047272-421b-4187-99a6-e18e4a01bfc9: rpc.has_security_group_logging(os_id): False [ 704.335469] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.335709] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.336030] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.336314] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.337283] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.337283] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.337283] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.337283] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.337283] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.339029] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.340625] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.340739] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.340805] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.340975] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.341784] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.342668] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.342668] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.342884] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.342884] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.342947] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.343055] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 96047272-421b-4187-99a6-e18e4a01bfc9 is going to be updated. [ 704.385059] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ba6f8661-b38c-4d97-a1c5-4a0e33e341bc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.416886] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.418522] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.418522] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.418522] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.418522] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.432531] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 96047272-421b-4187-99a6-e18e4a01bfc9 in Status: IN_PROGRESS for 2s [ 704.591078] env[68328]: INFO networking_nsxv3.common.synchronization [req-08b1bb54-c0a5-405c-b6c5-de6b3099be62 req-0206b3b4-a1a5-46ca-beda-a05ac40f3eb5 tempest-ServersTestMultiNic-360170984 tempest-ServersTestMultiNic-360170984-project-member] Enqueued Resource ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc with Priority: HIGHEST for action security_group_members [ 704.591865] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc with Priority: HIGHEST for action security_group_members [ 704.592992] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.592992] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.662706] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-349 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.662706] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-349" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.662706] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-349" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.672328] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-349" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.672328] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.672328] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.672328] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.672328] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.672328] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.672328] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 704.672328] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 704.676108] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 704.676108] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 704.676108] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 704.676108] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 704.676108] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 704.699176] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 704.699373] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 704.699515] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 704.699714] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-349" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.700087] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-64d78116-240a-40f0-aa61-a667095b9587 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.700273] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-64d78116-240a-40f0-aa61-a667095b9587" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.701052] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-64d78116-240a-40f0-aa61-a667095b9587" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.701052] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-64d78116-240a-40f0-aa61-a667095b9587" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.701052] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64d78116-240a-40f0-aa61-a667095b9587',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.876659] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55dff300-131a-42f9-920d-f2b5a3b91449 in Status: SUCCESS [ 704.880364] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.881039] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.881299] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.881484] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.881608] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.881691] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.881891] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.881982] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.882684] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.882684] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('55dff300-131a-42f9-920d-f2b5a3b91449',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.891912] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.891912] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.891912] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.891912] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.891912] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.891912] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc is going to be updated. [ 704.918182] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.918182] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.918182] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.918467] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.918467] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.926529] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc in Status: IN_PROGRESS for 2s [ 705.205733] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.206138] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.206138] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.206485] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.207181] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.207181] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 64d78116-240a-40f0-aa61-a667095b9587 not found, creating... [ 705.211163] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.211163] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.211163] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.211163] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.211163] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.211163] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.211163] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.211163] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.211163] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.211163] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.212137] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 64d78116-240a-40f0-aa61-a667095b9587 is going to be created. [ 705.239343] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.239834] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.240069] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.240473] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.240722] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.241248] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-64d78116-240a-40f0-aa61-a667095b9587" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.385362] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-55dff300-131a-42f9-920d-f2b5a3b91449 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.385506] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.385865] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.385865] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.386018] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.386148] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.386211] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.386393] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.387455] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.387455] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.387455] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-55dff300-131a-42f9-920d-f2b5a3b91449 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.387455] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.387455] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.387455] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.387455] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.387455] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.387455] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.387938] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.387938] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.387938] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.387938] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('55dff300-131a-42f9-920d-f2b5a3b91449',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.798411] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e39d3b8-c430-4219-9295-992b699ce546 in Status: SUCCESS [ 705.798749] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e39d3b8-c430-4219-9295-992b699ce546" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.799074] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e39d3b8-c430-4219-9295-992b699ce546" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.800381] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e39d3b8-c430-4219-9295-992b699ce546" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.800381] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.800381] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.800381] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.800381] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.800381] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.800381] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e39d3b8-c430-4219-9295-992b699ce546" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.800381] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6e39d3b8-c430-4219-9295-992b699ce546',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.890768] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 55dff300-131a-42f9-920d-f2b5a3b91449: rpc.has_security_group_logging(os_id): False [ 705.915553] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.915553] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.915553] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.915553] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.915553] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.915553] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.916160] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.916160] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.916160] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.916160] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.916160] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.916468] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.916468] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.916468] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.916859] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.916859] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.916859] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.917059] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.917532] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.917658] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.917730] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55dff300-131a-42f9-920d-f2b5a3b91449 is going to be updated. [ 705.977984] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.978170] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.979039] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.979039] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.979039] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.991654] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55dff300-131a-42f9-920d-f2b5a3b91449 in Status: IN_PROGRESS for 2s [ 706.304653] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6e39d3b8-c430-4219-9295-992b699ce546',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.417183] env[68328]: INFO networking_nsxv3.common.synchronization [req-26c4960b-5451-44b6-a029-67c22b60d0df req-7b6c0942-5a8e-496a-a34a-aea81ab1f662 tempest-ServersAdminTestJSON-340534059 tempest-ServersAdminTestJSON-340534059-project-member] Enqueued Resource ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed with Priority: HIGHEST for action security_group_members [ 706.417183] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed with Priority: HIGHEST for action security_group_members [ 706.417183] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.418532] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.418771] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.421188] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.421188] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.421188] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.421188] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.421188] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.421188] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.421188] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.443548] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 96047272-421b-4187-99a6-e18e4a01bfc9 in Status: SUCCESS [ 706.443805] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.455520] env[68328]: INFO networking_nsxv3.common.synchronization [None req-86e51c06-2211-483e-acfe-08f43d260eb1 None None] Enqueued Resource ID: 440b0a9f-e3e5-4867-b891-ea1b9efa663c with Priority: HIGHEST for action port [ 706.456018] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 440b0a9f-e3e5-4867-b891-ea1b9efa663c with Priority: HIGHEST for action port [ 706.456366] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-440b0a9f-e3e5-4867-b891-ea1b9efa663c taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.456489] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-440b0a9f-e3e5-4867-b891-ea1b9efa663c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.456554] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-440b0a9f-e3e5-4867-b891-ea1b9efa663c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.456821] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-440b0a9f-e3e5-4867-b891-ea1b9efa663c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.456954] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('440b0a9f-e3e5-4867-b891-ea1b9efa663c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.688775] env[68328]: INFO networking_nsxv3.common.synchronization [req-a8a5eee4-5c23-47d7-930a-58c90b1106d0 req-06178d01-2c83-419d-ac17-b448e74ee7db service nova] Enqueued Resource ID: 3826a056-9a94-48ea-97d8-49b840d3fb63 with Priority: HIGHEST for action security_group_rules [ 706.689035] env[68328]: INFO networking_nsxv3.common.synchronization [req-a8a5eee4-5c23-47d7-930a-58c90b1106d0 req-06178d01-2c83-419d-ac17-b448e74ee7db service nova] Enqueued Resource ID: 3826a056-9a94-48ea-97d8-49b840d3fb63 with Priority: HIGHEST for action security_group_members [ 706.689225] env[68328]: INFO networking_nsxv3.common.synchronization [req-a8a5eee4-5c23-47d7-930a-58c90b1106d0 req-06178d01-2c83-419d-ac17-b448e74ee7db service nova] Enqueued Resource ID: 64d78116-240a-40f0-aa61-a667095b9587 with Priority: HIGHEST for action port [ 706.689470] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3826a056-9a94-48ea-97d8-49b840d3fb63 with Priority: HIGHEST for action security_group_rules [ 706.689610] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3826a056-9a94-48ea-97d8-49b840d3fb63 with Priority: HIGHEST for action security_group_members [ 706.689703] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64d78116-240a-40f0-aa61-a667095b9587 with Priority: HIGHEST for action port [ 706.692510] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3826a056-9a94-48ea-97d8-49b840d3fb63 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.692644] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3826a056-9a94-48ea-97d8-49b840d3fb63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.692707] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3826a056-9a94-48ea-97d8-49b840d3fb63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.692912] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3826a056-9a94-48ea-97d8-49b840d3fb63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.693009] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3826a056-9a94-48ea-97d8-49b840d3fb63',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.694514] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-3826a056-9a94-48ea-97d8-49b840d3fb63 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.694635] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3826a056-9a94-48ea-97d8-49b840d3fb63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.694695] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3826a056-9a94-48ea-97d8-49b840d3fb63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.695309] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3826a056-9a94-48ea-97d8-49b840d3fb63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.695389] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.695445] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.695543] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.695650] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.695734] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.696042] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3826a056-9a94-48ea-97d8-49b840d3fb63',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.697669] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-64d78116-240a-40f0-aa61-a667095b9587 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.697885] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-64d78116-240a-40f0-aa61-a667095b9587" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.697919] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-64d78116-240a-40f0-aa61-a667095b9587" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.698076] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-64d78116-240a-40f0-aa61-a667095b9587" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.698289] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64d78116-240a-40f0-aa61-a667095b9587',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.807227] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6e39d3b8-c430-4219-9295-992b699ce546: rpc.has_security_group_logging(os_id): False [ 706.828768] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.828768] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.828768] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.828768] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.828768] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.828768] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.828768] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.828768] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.828768] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.828768] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.828768] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e39d3b8-c430-4219-9295-992b699ce546 is going to be created. [ 706.870668] env[68328]: INFO networking_nsxv3.common.synchronization [req-05fcf16a-8327-4c56-b5be-e38d7d4196b0 req-dc173dd4-4dc5-4765-8ca2-264d46071cdf tempest-ImagesNegativeTestJSON-174892724 tempest-ImagesNegativeTestJSON-174892724-project-member] Enqueued Resource ID: c8026099-4b7a-433d-98f2-b33d3f0a6907 with Priority: HIGHEST for action security_group_members [ 706.871182] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8026099-4b7a-433d-98f2-b33d3f0a6907 with Priority: HIGHEST for action security_group_members [ 706.871505] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8026099-4b7a-433d-98f2-b33d3f0a6907 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.871611] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8026099-4b7a-433d-98f2-b33d3f0a6907" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.871735] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8026099-4b7a-433d-98f2-b33d3f0a6907" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.871915] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8026099-4b7a-433d-98f2-b33d3f0a6907" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.872901] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.872901] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.873069] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.873362] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.873362] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.873362] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8026099-4b7a-433d-98f2-b33d3f0a6907',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.884874] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.884874] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.884874] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.884874] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.884874] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.892503] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e39d3b8-c430-4219-9295-992b699ce546 in Status: IN_PROGRESS for 2s [ 706.925415] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.958798] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 440b0a9f-e3e5-4867-b891-ea1b9efa663c [ 706.959118] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.959263] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.959333] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.959544] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.959632] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.959750] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:440b0a9f-e3e5-4867-b891-ea1b9efa663c already deleted. [ 706.959796] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-440b0a9f-e3e5-4867-b891-ea1b9efa663c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.984294] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc in Status: SUCCESS [ 706.985416] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.985416] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.985416] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.985416] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.985416] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.985416] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.985739] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.985739] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.985803] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba6f8661-b38c-4d97-a1c5-4a0e33e341bc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.195044] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-3826a056-9a94-48ea-97d8-49b840d3fb63 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.195257] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3826a056-9a94-48ea-97d8-49b840d3fb63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.199078] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3826a056-9a94-48ea-97d8-49b840d3fb63',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.201533] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 64d78116-240a-40f0-aa61-a667095b9587 with status ACTIVE [ 707.203153] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.203153] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.203153] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.203153] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.203153] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.203153] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.203446] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.203550] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.203773] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.203869] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.204095] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.204202] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.204270] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.204483] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.204483] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.204586] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 64d78116-240a-40f0-aa61-a667095b9587 is going to be updated. [ 707.225700] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.225700] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.225700] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.225700] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.225700] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.225700] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-64d78116-240a-40f0-aa61-a667095b9587" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.382607] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.382607] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.382607] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.382607] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.382607] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.382607] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.382607] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.382607] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.382607] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.382607] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.382607] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8026099-4b7a-433d-98f2-b33d3f0a6907 is going to be updated. [ 707.390973] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-847 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.393018] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-847" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.393018] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-847" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.393018] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-847" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.393018] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.393018] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.393018] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.393018] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.393477] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.393814] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 707.394054] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 707.394282] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 707.394484] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 707.394689] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 707.394886] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 707.395123] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 707.422657] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.423224] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.423527] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.423892] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.424169] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.427513] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.430300] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 707.430979] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 707.431432] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 707.431823] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-847" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.432357] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-07c02f8a-364c-4c2f-88d2-923cd3dbac64 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.432753] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-07c02f8a-364c-4c2f-88d2-923cd3dbac64" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.433026] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-07c02f8a-364c-4c2f-88d2-923cd3dbac64" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.433575] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-07c02f8a-364c-4c2f-88d2-923cd3dbac64" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.433891] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07c02f8a-364c-4c2f-88d2-923cd3dbac64',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.443111] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8026099-4b7a-433d-98f2-b33d3f0a6907 in Status: IN_PROGRESS for 2s [ 707.488629] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.489375] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.489375] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.489375] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.489375] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.489599] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.489599] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.489690] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.490310] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.491118] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.491118] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc is going to be updated. [ 707.529144] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.529144] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.529144] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.529144] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.529338] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.538737] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc in Status: IN_PROGRESS for 2s [ 707.608309] env[68328]: INFO networking_nsxv3.common.synchronization [req-78becec9-026f-4282-810e-009793ba06d2 req-77cd65d7-c402-4d38-a734-36bbe286e327 tempest-MultipleCreateTestJSON-885002055 tempest-MultipleCreateTestJSON-885002055-project-member] Enqueued Resource ID: 96047272-421b-4187-99a6-e18e4a01bfc9 with Priority: HIGHEST for action security_group_members [ 707.608860] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96047272-421b-4187-99a6-e18e4a01bfc9 with Priority: HIGHEST for action security_group_members [ 707.609661] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-96047272-421b-4187-99a6-e18e4a01bfc9 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.616274] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.616274] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.616274] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.616274] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.616274] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.616274] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.616274] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.616274] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.616274] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('96047272-421b-4187-99a6-e18e4a01bfc9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.702347] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3826a056-9a94-48ea-97d8-49b840d3fb63',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.930466] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.930811] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.930811] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.930992] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.932552] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.932552] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed is going to be updated. [ 707.936209] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.937180] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.937180] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.937180] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.937180] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.937582] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 07c02f8a-364c-4c2f-88d2-923cd3dbac64 not found, creating... [ 707.938023] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.938876] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.938876] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.939139] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.940730] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.940730] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.940730] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.940730] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.940730] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.941022] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.941022] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 07c02f8a-364c-4c2f-88d2-923cd3dbac64 is going to be created. [ 707.958419] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.958575] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.962374] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.962374] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.962374] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.962374] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-07c02f8a-364c-4c2f-88d2-923cd3dbac64" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.969378] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.969517] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.969592] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.969807] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.970125] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.978084] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed in Status: IN_PROGRESS for 2s [ 708.017161] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55dff300-131a-42f9-920d-f2b5a3b91449 in Status: SUCCESS [ 708.017161] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.121039] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('96047272-421b-4187-99a6-e18e4a01bfc9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.206480] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.206691] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.206759] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.207644] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.207644] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.207644] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3826a056-9a94-48ea-97d8-49b840d3fb63 is going to be created. [ 708.238121] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.238121] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.238274] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.239043] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.239043] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.257633] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3826a056-9a94-48ea-97d8-49b840d3fb63 in Status: UNINITIALIZED for 2s [ 708.373318] env[68328]: INFO networking_nsxv3.common.synchronization [req-4821266d-e119-4824-a4eb-4461db9ed159 req-47aabf52-a036-4bd2-982f-68241d893a24 tempest-MultipleCreateTestJSON-885002055 tempest-MultipleCreateTestJSON-885002055-project-member] Enqueued Resource ID: 96047272-421b-4187-99a6-e18e4a01bfc9 with Priority: HIGHEST for action security_group_members [ 708.374367] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96047272-421b-4187-99a6-e18e4a01bfc9 with Priority: HIGHEST for action security_group_members [ 708.374991] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-96047272-421b-4187-99a6-e18e4a01bfc9 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.375317] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.624336] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('96047272-421b-4187-99a6-e18e4a01bfc9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.730443] env[68328]: INFO networking_nsxv3.common.synchronization [req-26c4960b-5451-44b6-a029-67c22b60d0df req-235fe0be-c1b5-4568-8bcf-a8492ef8ff50 service nova] Enqueued Resource ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed with Priority: HIGHEST for action security_group_rules [ 708.730641] env[68328]: INFO networking_nsxv3.common.synchronization [req-26c4960b-5451-44b6-a029-67c22b60d0df req-235fe0be-c1b5-4568-8bcf-a8492ef8ff50 service nova] Enqueued Resource ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed with Priority: HIGHEST for action security_group_members [ 708.730784] env[68328]: INFO networking_nsxv3.common.synchronization [req-26c4960b-5451-44b6-a029-67c22b60d0df req-235fe0be-c1b5-4568-8bcf-a8492ef8ff50 service nova] Enqueued Resource ID: 07c02f8a-364c-4c2f-88d2-923cd3dbac64 with Priority: HIGHEST for action port [ 708.731024] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed with Priority: HIGHEST for action security_group_rules [ 708.731156] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed with Priority: HIGHEST for action security_group_members [ 708.731250] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07c02f8a-364c-4c2f-88d2-923cd3dbac64 with Priority: HIGHEST for action port [ 708.731788] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.731911] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.731976] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.734051] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.734051] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.734381] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.734510] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.734739] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-07c02f8a-364c-4c2f-88d2-923cd3dbac64 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.738011] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-07c02f8a-364c-4c2f-88d2-923cd3dbac64" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.738011] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-07c02f8a-364c-4c2f-88d2-923cd3dbac64" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.738011] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-07c02f8a-364c-4c2f-88d2-923cd3dbac64" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.738011] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07c02f8a-364c-4c2f-88d2-923cd3dbac64',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.904627] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e39d3b8-c430-4219-9295-992b699ce546 in Status: SUCCESS [ 708.905137] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e39d3b8-c430-4219-9295-992b699ce546" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.126341] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.126702] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.126702] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.126840] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.126936] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.127078] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96047272-421b-4187-99a6-e18e4a01bfc9 is going to be updated. [ 709.163049] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.163049] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.163049] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.163049] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.163049] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.171689] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96047272-421b-4187-99a6-e18e4a01bfc9 in Status: IN_PROGRESS for 2s [ 709.237736] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.237736] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.237888] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 07c02f8a-364c-4c2f-88d2-923cd3dbac64 with status ACTIVE [ 709.238328] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.238328] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.238465] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.238654] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.238775] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.239030] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.239096] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.239157] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.239334] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.239442] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.239668] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.239805] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.239886] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.240072] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.240122] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.240206] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 07c02f8a-364c-4c2f-88d2-923cd3dbac64 is going to be updated. [ 709.268270] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.268477] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.268556] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.268874] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.269137] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.269386] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-07c02f8a-364c-4c2f-88d2-923cd3dbac64" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.455695] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8026099-4b7a-433d-98f2-b33d3f0a6907 in Status: SUCCESS [ 709.455955] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8026099-4b7a-433d-98f2-b33d3f0a6907 deletion is rescheduled due to dependency. [ 709.456046] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8026099-4b7a-433d-98f2-b33d3f0a6907" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.550476] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc in Status: SUCCESS [ 709.550709] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc deletion is rescheduled due to dependency. [ 709.550845] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.551039] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.551307] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.551491] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.551610] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.551685] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.551855] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.551945] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.552056] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba6f8661-b38c-4d97-a1c5-4a0e33e341bc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.756016] env[68328]: INFO networking_nsxv3.common.synchronization [None req-5dd84974-98f7-4663-a5ad-ee8dbdb9bc13 None None] Enqueued Resource ID: 35ec7f90-5332-43b4-9975-cc8b1596561b with Priority: HIGHEST for action port [ 709.758544] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35ec7f90-5332-43b4-9975-cc8b1596561b with Priority: HIGHEST for action port [ 709.760342] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-35ec7f90-5332-43b4-9975-cc8b1596561b taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.760342] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-35ec7f90-5332-43b4-9975-cc8b1596561b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.760342] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-35ec7f90-5332-43b4-9975-cc8b1596561b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.768992] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-35ec7f90-5332-43b4-9975-cc8b1596561b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.768992] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35ec7f90-5332-43b4-9975-cc8b1596561b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.990765] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed in Status: SUCCESS [ 709.990765] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.990765] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.990765] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.990765] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.990765] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.990765] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.990765] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.990765] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.990765] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.054281] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.054523] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.054523] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.058043] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.058043] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.058043] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.058043] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.058043] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.058043] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.058043] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.058043] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc is going to be updated. [ 710.083463] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.083463] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.083463] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.083463] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.083463] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.093679] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc in Status: IN_PROGRESS for 2s [ 710.266854] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3826a056-9a94-48ea-97d8-49b840d3fb63 in Status: SUCCESS [ 710.267600] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3826a056-9a94-48ea-97d8-49b840d3fb63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.267600] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3826a056-9a94-48ea-97d8-49b840d3fb63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.267600] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3826a056-9a94-48ea-97d8-49b840d3fb63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.267813] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.267813] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.267813] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.267957] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.268050] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.268129] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3826a056-9a94-48ea-97d8-49b840d3fb63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.269028] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3826a056-9a94-48ea-97d8-49b840d3fb63',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.272037] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 35ec7f90-5332-43b4-9975-cc8b1596561b [ 710.272225] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.272349] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.272415] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.272581] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.272668] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.272740] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:35ec7f90-5332-43b4-9975-cc8b1596561b already deleted. [ 710.272819] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-35ec7f90-5332-43b4-9975-cc8b1596561b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.496782] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.771499] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3826a056-9a94-48ea-97d8-49b840d3fb63',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.000775] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.183199] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96047272-421b-4187-99a6-e18e4a01bfc9 in Status: SUCCESS [ 711.183199] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.183436] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.183570] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.183765] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.183908] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.183974] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.184160] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.184259] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.184355] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('96047272-421b-4187-99a6-e18e4a01bfc9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.274870] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3826a056-9a94-48ea-97d8-49b840d3fb63: rpc.has_security_group_logging(os_id): False [ 711.292571] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.292699] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.292699] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.292931] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.293032] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.293295] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.293833] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.293833] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.293833] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.293833] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.294021] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3826a056-9a94-48ea-97d8-49b840d3fb63 is going to be created. [ 711.339983] env[68328]: INFO networking_nsxv3.common.synchronization [req-061457e1-5440-4640-972c-1f8dc505a401 req-a809a1c6-c221-4cc1-8ff5-4b33e45ddccb tempest-VolumesAdminNegativeTest-207194333 tempest-VolumesAdminNegativeTest-207194333-project-member] Enqueued Resource ID: b3fc1540-17fb-42c4-99d2-880ae35db079 with Priority: HIGHEST for action security_group_members [ 711.340509] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3fc1540-17fb-42c4-99d2-880ae35db079 with Priority: HIGHEST for action security_group_members [ 711.340813] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3fc1540-17fb-42c4-99d2-880ae35db079 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.340963] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3fc1540-17fb-42c4-99d2-880ae35db079" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.341008] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3fc1540-17fb-42c4-99d2-880ae35db079" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.345279] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3fc1540-17fb-42c4-99d2-880ae35db079" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.345470] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.345625] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.345686] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.348394] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.348394] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.348394] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b3fc1540-17fb-42c4-99d2-880ae35db079',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.363308] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.363456] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.363757] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.364020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.364448] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.398167] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3826a056-9a94-48ea-97d8-49b840d3fb63 in Status: IN_PROGRESS for 2s [ 711.505878] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.507000] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.507174] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.507417] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.507516] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.508068] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed is going to be updated. [ 711.543642] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.543838] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.543890] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.544099] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.544270] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.555641] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed in Status: IN_PROGRESS for 2s [ 711.689463] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.689463] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.690276] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.690276] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.690276] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.690969] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.690969] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.690969] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.691317] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.692583] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.692583] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96047272-421b-4187-99a6-e18e4a01bfc9 is going to be updated. [ 711.722269] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.722508] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.722508] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.722735] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.722908] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.731061] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96047272-421b-4187-99a6-e18e4a01bfc9 in Status: IN_PROGRESS for 2s [ 711.851321] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.851494] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.851562] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.851918] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.851918] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.852074] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.852155] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.852217] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.852386] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.852464] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.852558] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b3fc1540-17fb-42c4-99d2-880ae35db079 already deleted. [ 711.852641] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3fc1540-17fb-42c4-99d2-880ae35db079" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.103332] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc in Status: SUCCESS [ 712.103332] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc deletion is rescheduled due to dependency. [ 712.103332] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.160041] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-614 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.160041] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-614" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.160041] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-614" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.160519] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-614" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.160633] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.161849] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.161849] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.162037] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.162142] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.162404] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 712.162577] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 712.162732] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 712.162884] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 712.163064] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 712.163268] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 712.163485] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 712.185914] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 712.186195] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 712.187837] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 712.187837] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-614" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.187837] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-0774002a-dacb-4e7f-b795-eb5263504568 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.187837] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-0774002a-dacb-4e7f-b795-eb5263504568" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.187837] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-0774002a-dacb-4e7f-b795-eb5263504568" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.187837] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-0774002a-dacb-4e7f-b795-eb5263504568" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.187837] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0774002a-dacb-4e7f-b795-eb5263504568',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.693149] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.693149] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.693149] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.693149] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.693149] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.693149] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 0774002a-dacb-4e7f-b795-eb5263504568 not found, creating... [ 712.693149] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.693149] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.693149] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.693149] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.693149] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.693840] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.693840] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.693840] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.693840] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.693840] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.693840] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 0774002a-dacb-4e7f-b795-eb5263504568 is going to be created. [ 712.715029] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.715029] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.715029] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.715029] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.715339] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.715339] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-0774002a-dacb-4e7f-b795-eb5263504568" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.763463] env[68328]: INFO networking_nsxv3.common.synchronization [None req-5910b693-9904-4f72-aba1-47815d498e86 None None] Enqueued Resource ID: 39f4a414-cb3b-4c83-8153-aefc8c36ecdb with Priority: HIGHEST for action port [ 712.764026] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39f4a414-cb3b-4c83-8153-aefc8c36ecdb with Priority: HIGHEST for action port [ 712.764386] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-39f4a414-cb3b-4c83-8153-aefc8c36ecdb taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.764527] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39f4a414-cb3b-4c83-8153-aefc8c36ecdb" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.765692] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39f4a414-cb3b-4c83-8153-aefc8c36ecdb" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.765692] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39f4a414-cb3b-4c83-8153-aefc8c36ecdb" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.765692] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39f4a414-cb3b-4c83-8153-aefc8c36ecdb',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.267570] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 39f4a414-cb3b-4c83-8153-aefc8c36ecdb [ 713.267870] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.268080] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.268080] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.268602] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.268602] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.268602] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:39f4a414-cb3b-4c83-8153-aefc8c36ecdb already deleted. [ 713.268783] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39f4a414-cb3b-4c83-8153-aefc8c36ecdb" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.411891] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3826a056-9a94-48ea-97d8-49b840d3fb63 in Status: SUCCESS [ 713.411891] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3826a056-9a94-48ea-97d8-49b840d3fb63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.568827] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed in Status: SUCCESS [ 713.569361] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.569612] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.571747] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.571747] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.571747] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.571747] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.571747] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.571747] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.571747] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.571747] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.672318] env[68328]: INFO networking_nsxv3.common.synchronization [req-061457e1-5440-4640-972c-1f8dc505a401 req-91aaf52a-8d30-43d2-8f00-0a84ea81d821 service nova] Enqueued Resource ID: b3fc1540-17fb-42c4-99d2-880ae35db079 with Priority: HIGHEST for action security_group_rules [ 713.672318] env[68328]: INFO networking_nsxv3.common.synchronization [req-061457e1-5440-4640-972c-1f8dc505a401 req-91aaf52a-8d30-43d2-8f00-0a84ea81d821 service nova] Enqueued Resource ID: b3fc1540-17fb-42c4-99d2-880ae35db079 with Priority: HIGHEST for action security_group_members [ 713.672468] env[68328]: INFO networking_nsxv3.common.synchronization [req-061457e1-5440-4640-972c-1f8dc505a401 req-91aaf52a-8d30-43d2-8f00-0a84ea81d821 service nova] Enqueued Resource ID: 0774002a-dacb-4e7f-b795-eb5263504568 with Priority: HIGHEST for action port [ 713.673108] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3fc1540-17fb-42c4-99d2-880ae35db079 with Priority: HIGHEST for action security_group_rules [ 713.673108] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3fc1540-17fb-42c4-99d2-880ae35db079 with Priority: HIGHEST for action security_group_members [ 713.673108] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0774002a-dacb-4e7f-b795-eb5263504568 with Priority: HIGHEST for action port [ 713.675415] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b3fc1540-17fb-42c4-99d2-880ae35db079 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.675556] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b3fc1540-17fb-42c4-99d2-880ae35db079" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.675621] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b3fc1540-17fb-42c4-99d2-880ae35db079" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.675827] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b3fc1540-17fb-42c4-99d2-880ae35db079" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.675902] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b3fc1540-17fb-42c4-99d2-880ae35db079',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.676768] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3fc1540-17fb-42c4-99d2-880ae35db079 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.676896] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3fc1540-17fb-42c4-99d2-880ae35db079" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.676956] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3fc1540-17fb-42c4-99d2-880ae35db079" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.677105] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3fc1540-17fb-42c4-99d2-880ae35db079" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.677240] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.677327] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.677385] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.677522] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.677601] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.677693] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b3fc1540-17fb-42c4-99d2-880ae35db079',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.678744] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-0774002a-dacb-4e7f-b795-eb5263504568 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.678744] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0774002a-dacb-4e7f-b795-eb5263504568" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.678744] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0774002a-dacb-4e7f-b795-eb5263504568" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.678891] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0774002a-dacb-4e7f-b795-eb5263504568" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.678891] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0774002a-dacb-4e7f-b795-eb5263504568',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.740793] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96047272-421b-4187-99a6-e18e4a01bfc9 in Status: SUCCESS [ 713.741072] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96047272-421b-4187-99a6-e18e4a01bfc9 deletion is rescheduled due to dependency. [ 713.741200] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.080253] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.080253] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.080253] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.080253] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.080253] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.080253] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.080253] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.080253] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.080253] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.080253] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.080253] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.080253] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.080253] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.080253] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.080253] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.080253] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.084258] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.084258] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.084258] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.084258] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.084258] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.109318] env[68328]: INFO networking_nsxv3.common.synchronization [req-8a4e89a2-f1ef-4267-ab09-473417e2cdca req-2292f548-89eb-42af-b1e7-c0b239bed7c0 tempest-SecurityGroupsTestJSON-429138018 tempest-SecurityGroupsTestJSON-429138018-project-member] Enqueued Resource ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 with Priority: HIGHEST for action security_group_members [ 714.113023] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 with Priority: HIGHEST for action security_group_members [ 714.113170] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-870ec36b-ba1d-4422-a26d-1328f51f79e4 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.113262] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.113346] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.113701] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.113877] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.113999] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.114080] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.114240] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.114344] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.114442] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.182834] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3fc1540-17fb-42c4-99d2-880ae35db079 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.182834] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3fc1540-17fb-42c4-99d2-880ae35db079" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.182834] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b3fc1540-17fb-42c4-99d2-880ae35db079',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.182834] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0774002a-dacb-4e7f-b795-eb5263504568 with status ACTIVE [ 714.182834] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.182834] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.182834] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.183284] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.183284] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.183284] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.183394] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.183394] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.183553] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.184347] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.184347] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.184347] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.184347] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.188251] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.188405] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.188540] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0774002a-dacb-4e7f-b795-eb5263504568 is going to be updated. [ 714.209763] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.209763] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.209763] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.209763] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.209978] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.209978] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0774002a-dacb-4e7f-b795-eb5263504568" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.582955] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed: rpc.has_security_group_logging(os_id): False [ 714.599718] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.599867] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.600016] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.600474] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.600578] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.600809] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.600917] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.600985] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.601175] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.601258] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.601489] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.601558] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.601602] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.601742] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.601818] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.602012] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.602351] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.602416] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.602557] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.602634] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.602720] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed is going to be updated. [ 714.617100] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.617308] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.617381] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.617610] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.617704] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.617896] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.617991] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.618103] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.618259] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.618335] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.618421] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 already deleted. [ 714.618499] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.657941] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.658098] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.658185] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.658375] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.658507] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.663520] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-852 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.664053] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-852" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.669017] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-852" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.669017] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-852" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.669017] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.669017] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.669017] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.669017] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.669017] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.669017] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 714.670123] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 714.670334] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 714.670502] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 714.670666] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 714.670824] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 714.671025] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 714.672767] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed in Status: IN_PROGRESS for 2s [ 714.691022] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 714.691022] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 714.691022] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 714.691022] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-852" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.691022] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-f3d28b00-a4b9-4d07-8f89-ca4bfef187a2 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.691022] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-f3d28b00-a4b9-4d07-8f89-ca4bfef187a2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.691022] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-f3d28b00-a4b9-4d07-8f89-ca4bfef187a2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.691022] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-f3d28b00-a4b9-4d07-8f89-ca4bfef187a2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.691022] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3d28b00-a4b9-4d07-8f89-ca4bfef187a2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.696023] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b3fc1540-17fb-42c4-99d2-880ae35db079',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.198249] env[68328]: INFO networking_nsxv3.common.synchronization [None req-b55969f6-0226-4627-a90c-85250ccab9f1 None None] Enqueued Resource ID: 3be32653-5d1b-406a-b80c-57de926fe153 with Priority: HIGHEST for action port [ 715.198249] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3be32653-5d1b-406a-b80c-57de926fe153 with Priority: HIGHEST for action port [ 715.198249] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-3be32653-5d1b-406a-b80c-57de926fe153 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.199185] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3be32653-5d1b-406a-b80c-57de926fe153" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.199336] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3be32653-5d1b-406a-b80c-57de926fe153" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.199530] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3be32653-5d1b-406a-b80c-57de926fe153" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.199613] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3be32653-5d1b-406a-b80c-57de926fe153',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.200711] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.200711] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.201147] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.201147] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.201147] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.201147] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b3fc1540-17fb-42c4-99d2-880ae35db079 is going to be created. [ 715.202392] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.204102] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.204102] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.204102] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.204102] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.204102] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port f3d28b00-a4b9-4d07-8f89-ca4bfef187a2 not found, creating... [ 715.204102] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.204102] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.204357] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.204732] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.204732] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.204937] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.205127] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.205244] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.205459] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.205636] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.206736] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: f3d28b00-a4b9-4d07-8f89-ca4bfef187a2 is going to be created. [ 715.227162] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.227313] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.227438] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.228052] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.228052] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.228207] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-f3d28b00-a4b9-4d07-8f89-ca4bfef187a2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.230537] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.231312] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.231312] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.231312] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.231312] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.240077] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3fc1540-17fb-42c4-99d2-880ae35db079 in Status: UNINITIALIZED for 2s [ 715.708907] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3be32653-5d1b-406a-b80c-57de926fe153 [ 715.709114] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.709568] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.709568] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.709568] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.709767] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.709767] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3be32653-5d1b-406a-b80c-57de926fe153 already deleted. [ 715.709833] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3be32653-5d1b-406a-b80c-57de926fe153" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.057890] env[68328]: INFO networking_nsxv3.common.synchronization [req-8a4e89a2-f1ef-4267-ab09-473417e2cdca req-e531d576-c02b-4446-9222-9d647f0e0d7a service nova] Enqueued Resource ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 with Priority: HIGHEST for action security_group_rules [ 716.058097] env[68328]: INFO networking_nsxv3.common.synchronization [req-8a4e89a2-f1ef-4267-ab09-473417e2cdca req-e531d576-c02b-4446-9222-9d647f0e0d7a service nova] Enqueued Resource ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 with Priority: HIGHEST for action security_group_members [ 716.058267] env[68328]: INFO networking_nsxv3.common.synchronization [req-8a4e89a2-f1ef-4267-ab09-473417e2cdca req-e531d576-c02b-4446-9222-9d647f0e0d7a service nova] Enqueued Resource ID: f3d28b00-a4b9-4d07-8f89-ca4bfef187a2 with Priority: HIGHEST for action port [ 716.058640] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 with Priority: HIGHEST for action security_group_rules [ 716.058640] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 with Priority: HIGHEST for action security_group_members [ 716.058869] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3d28b00-a4b9-4d07-8f89-ca4bfef187a2 with Priority: HIGHEST for action port [ 716.059421] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-870ec36b-ba1d-4422-a26d-1328f51f79e4 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.059634] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.059634] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.060153] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.060153] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.063254] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-870ec36b-ba1d-4422-a26d-1328f51f79e4 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.063402] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.063474] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.063764] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.063836] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.063921] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.064036] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.064156] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.064233] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.064331] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.066366] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3d28b00-a4b9-4d07-8f89-ca4bfef187a2 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.066366] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3d28b00-a4b9-4d07-8f89-ca4bfef187a2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.066366] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3d28b00-a4b9-4d07-8f89-ca4bfef187a2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.066366] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3d28b00-a4b9-4d07-8f89-ca4bfef187a2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.066366] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3d28b00-a4b9-4d07-8f89-ca4bfef187a2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.567728] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f3d28b00-a4b9-4d07-8f89-ca4bfef187a2 with status ACTIVE [ 716.568034] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.568688] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.568688] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.568688] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.568688] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.568912] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.569166] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.569166] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.569933] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.569933] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.569933] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.569933] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.569933] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.569933] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.569933] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.570430] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f3d28b00-a4b9-4d07-8f89-ca4bfef187a2 is going to be updated. [ 716.571259] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-870ec36b-ba1d-4422-a26d-1328f51f79e4 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.572564] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.572564] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.591219] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.591401] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.591458] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.591881] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.591881] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.592023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3d28b00-a4b9-4d07-8f89-ca4bfef187a2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.686860] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed in Status: SUCCESS [ 716.686979] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.074638] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.249841] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3fc1540-17fb-42c4-99d2-880ae35db079 in Status: SUCCESS [ 717.250165] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3fc1540-17fb-42c4-99d2-880ae35db079" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.250436] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3fc1540-17fb-42c4-99d2-880ae35db079" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.250722] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3fc1540-17fb-42c4-99d2-880ae35db079" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.250982] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.251191] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.251315] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.251558] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.251797] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.251875] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3fc1540-17fb-42c4-99d2-880ae35db079" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.252014] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b3fc1540-17fb-42c4-99d2-880ae35db079',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.578497] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.582250] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.582250] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.582250] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.582250] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.582250] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 is going to be created. [ 717.607385] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.607516] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.607516] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.607780] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.607908] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.616611] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 in Status: UNINITIALIZED for 2s [ 717.757925] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b3fc1540-17fb-42c4-99d2-880ae35db079',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.260484] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b3fc1540-17fb-42c4-99d2-880ae35db079: rpc.has_security_group_logging(os_id): False [ 718.280132] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.280322] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.280425] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.280703] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.280824] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.281177] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.281350] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.281412] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.281593] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.281708] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.281815] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b3fc1540-17fb-42c4-99d2-880ae35db079 is going to be created. [ 718.340070] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.340271] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.340337] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.340569] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.340780] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.354033] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b3fc1540-17fb-42c4-99d2-880ae35db079 in Status: IN_PROGRESS for 2s [ 719.628315] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 in Status: SUCCESS [ 719.628736] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.630036] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.630036] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.630036] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.630036] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.630036] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.630036] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.630036] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.630036] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.630036] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.134691] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-870ec36b-ba1d-4422-a26d-1328f51f79e4 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.134691] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.134691] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.134936] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.136165] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.136165] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.136165] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.136165] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.136165] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.136165] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.136165] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-870ec36b-ba1d-4422-a26d-1328f51f79e4 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.136165] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.136165] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.136656] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.136656] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.136656] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.136656] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.136793] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.136883] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.139475] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.139475] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.370192] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b3fc1540-17fb-42c4-99d2-880ae35db079 in Status: SUCCESS [ 720.370532] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b3fc1540-17fb-42c4-99d2-880ae35db079" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.639222] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 870ec36b-ba1d-4422-a26d-1328f51f79e4: rpc.has_security_group_logging(os_id): False [ 720.656468] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.656568] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.656623] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.656846] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.656918] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.657827] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.657827] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.657827] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.657827] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.657827] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.657827] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.657827] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.658139] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.658139] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.658139] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.658287] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.658358] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.658419] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.658559] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.658634] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.658720] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 is going to be created. [ 720.714349] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.714492] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.714564] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.714819] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.714998] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.725073] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 in Status: IN_PROGRESS for 2s [ 721.047325] env[68328]: INFO networking_nsxv3.common.synchronization [None req-2c1cd95e-1198-456a-9eeb-879f3258f56d None None] Enqueued Resource ID: f9779594-2386-4e5a-bb60-f542becb0838 with Priority: HIGHEST for action port [ 721.047877] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9779594-2386-4e5a-bb60-f542becb0838 with Priority: HIGHEST for action port [ 721.048212] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-f9779594-2386-4e5a-bb60-f542becb0838 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.048359] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f9779594-2386-4e5a-bb60-f542becb0838" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.048465] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f9779594-2386-4e5a-bb60-f542becb0838" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.048685] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f9779594-2386-4e5a-bb60-f542becb0838" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.048769] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9779594-2386-4e5a-bb60-f542becb0838',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.555116] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f9779594-2386-4e5a-bb60-f542becb0838 [ 721.557091] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.557784] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.557900] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.558104] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.558220] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.558325] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f9779594-2386-4e5a-bb60-f542becb0838 already deleted. [ 721.558417] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f9779594-2386-4e5a-bb60-f542becb0838" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.743418] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 in Status: SUCCESS [ 722.743418] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.052172] env[68328]: INFO networking_nsxv3.common.synchronization [req-a0c2ef44-db6b-4848-9130-c19c2ba7a790 req-843ae913-f667-433c-9f3c-7a33a5606551 tempest-ServersAdminNegativeTestJSON-100889397 tempest-ServersAdminNegativeTestJSON-100889397-project-member] Enqueued Resource ID: 55dff300-131a-42f9-920d-f2b5a3b91449 with Priority: HIGHEST for action security_group_members [ 723.056540] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55dff300-131a-42f9-920d-f2b5a3b91449 with Priority: HIGHEST for action security_group_members [ 723.056540] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-55dff300-131a-42f9-920d-f2b5a3b91449 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.056699] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.056699] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.056906] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.057828] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.057828] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.057828] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.057828] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.057828] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.057828] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55dff300-131a-42f9-920d-f2b5a3b91449',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.195749] env[68328]: INFO networking_nsxv3.common.synchronization [req-1335b4a3-1f8f-4cc2-8533-d6b17d3b79a7 req-b5325a98-6c25-4466-bc8d-46287c21c36f tempest-AttachInterfacesTestJSON-966841523 tempest-AttachInterfacesTestJSON-966841523-project-member] Enqueued Resource ID: 76f74d16-9031-4472-a81b-f9ada0520a34 with Priority: HIGHEST for action security_group_members [ 723.196367] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76f74d16-9031-4472-a81b-f9ada0520a34 with Priority: HIGHEST for action security_group_members [ 723.196685] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-76f74d16-9031-4472-a81b-f9ada0520a34 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.196836] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76f74d16-9031-4472-a81b-f9ada0520a34" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.196890] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76f74d16-9031-4472-a81b-f9ada0520a34" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.198109] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76f74d16-9031-4472-a81b-f9ada0520a34" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.198109] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.198109] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.198109] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.198109] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.198109] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.198350] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76f74d16-9031-4472-a81b-f9ada0520a34',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.447923] env[68328]: INFO networking_nsxv3.common.synchronization [None req-59350ab7-9ecc-42ed-9764-3db5ae8473a8 None None] Enqueued Resource ID: 78ad5513-7755-482f-831e-20c846c1b339 with Priority: HIGHEST for action port [ 723.448203] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78ad5513-7755-482f-831e-20c846c1b339 with Priority: HIGHEST for action port [ 723.448765] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-78ad5513-7755-482f-831e-20c846c1b339 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.448891] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-78ad5513-7755-482f-831e-20c846c1b339" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.448957] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-78ad5513-7755-482f-831e-20c846c1b339" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.450473] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-78ad5513-7755-482f-831e-20c846c1b339" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.450578] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78ad5513-7755-482f-831e-20c846c1b339',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.559166] env[68328]: INFO networking_nsxv3.common.synchronization [None req-538ab972-a0b4-4925-9fab-158247e2cf19 None None] Enqueued Resource ID: b9211945-25f0-4bbf-a45d-3eca10be9892 with Priority: HIGHEST for action port [ 723.562252] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55dff300-131a-42f9-920d-f2b5a3b91449',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.564034] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9211945-25f0-4bbf-a45d-3eca10be9892 with Priority: HIGHEST for action port [ 723.567218] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9211945-25f0-4bbf-a45d-3eca10be9892 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.567218] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9211945-25f0-4bbf-a45d-3eca10be9892" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.567218] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9211945-25f0-4bbf-a45d-3eca10be9892" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.567218] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9211945-25f0-4bbf-a45d-3eca10be9892" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.567218] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9211945-25f0-4bbf-a45d-3eca10be9892',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.680990] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-615 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.680990] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-615" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.680990] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-615" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.681302] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-615" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.681576] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.681862] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.681862] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.682075] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.682593] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.682593] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 723.682593] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 723.682754] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 723.682790] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 723.682883] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 723.682987] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 723.683143] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 723.700360] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.700529] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.700600] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.700873] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.700946] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.701083] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.701180] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.701241] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.701405] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.701533] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.701572] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76f74d16-9031-4472-a81b-f9ada0520a34 already deleted. [ 723.701639] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76f74d16-9031-4472-a81b-f9ada0520a34" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.711599] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 723.711763] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 723.712470] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 723.712647] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-615" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.712958] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-21de7d01-c998-4ca7-b466-d6a19ba60e8c taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.713250] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-21de7d01-c998-4ca7-b466-d6a19ba60e8c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.713250] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-21de7d01-c998-4ca7-b466-d6a19ba60e8c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.713553] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-21de7d01-c998-4ca7-b466-d6a19ba60e8c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.713693] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21de7d01-c998-4ca7-b466-d6a19ba60e8c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.953199] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 78ad5513-7755-482f-831e-20c846c1b339 [ 723.953501] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.953614] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.953684] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.953900] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.953988] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.954108] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:78ad5513-7755-482f-831e-20c846c1b339 already deleted. [ 723.954336] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-78ad5513-7755-482f-831e-20c846c1b339" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.088123] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55dff300-131a-42f9-920d-f2b5a3b91449',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.088123] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b9211945-25f0-4bbf-a45d-3eca10be9892 [ 724.088123] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.088123] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.088123] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.088123] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.088123] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.088123] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b9211945-25f0-4bbf-a45d-3eca10be9892 already deleted. [ 724.088123] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9211945-25f0-4bbf-a45d-3eca10be9892" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.216796] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.217097] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.217255] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.217576] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.217765] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.217882] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 21de7d01-c998-4ca7-b466-d6a19ba60e8c not found, creating... [ 724.218213] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.218676] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.218676] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.218758] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.219399] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.219399] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.219551] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.219577] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.219993] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.219993] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.221817] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 21de7d01-c998-4ca7-b466-d6a19ba60e8c is going to be created. [ 724.239770] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.239991] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.240178] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.240528] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.240712] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.240942] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-21de7d01-c998-4ca7-b466-d6a19ba60e8c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.576890] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.576890] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.576890] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.576890] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.576890] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.576890] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55dff300-131a-42f9-920d-f2b5a3b91449 is going to be updated. [ 724.611089] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.611089] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.611089] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.611998] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.611998] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.625187] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55dff300-131a-42f9-920d-f2b5a3b91449 in Status: IN_PROGRESS for 2s [ 725.149197] env[68328]: INFO networking_nsxv3.common.synchronization [req-1335b4a3-1f8f-4cc2-8533-d6b17d3b79a7 req-652e0c45-99d2-4300-a403-68fae3af7179 service nova] Enqueued Resource ID: 76f74d16-9031-4472-a81b-f9ada0520a34 with Priority: HIGHEST for action security_group_rules [ 725.149410] env[68328]: INFO networking_nsxv3.common.synchronization [req-1335b4a3-1f8f-4cc2-8533-d6b17d3b79a7 req-652e0c45-99d2-4300-a403-68fae3af7179 service nova] Enqueued Resource ID: 76f74d16-9031-4472-a81b-f9ada0520a34 with Priority: HIGHEST for action security_group_members [ 725.153071] env[68328]: INFO networking_nsxv3.common.synchronization [req-1335b4a3-1f8f-4cc2-8533-d6b17d3b79a7 req-652e0c45-99d2-4300-a403-68fae3af7179 service nova] Enqueued Resource ID: 21de7d01-c998-4ca7-b466-d6a19ba60e8c with Priority: HIGHEST for action port [ 725.153071] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76f74d16-9031-4472-a81b-f9ada0520a34 with Priority: HIGHEST for action security_group_rules [ 725.153071] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76f74d16-9031-4472-a81b-f9ada0520a34 with Priority: HIGHEST for action security_group_members [ 725.153071] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21de7d01-c998-4ca7-b466-d6a19ba60e8c with Priority: HIGHEST for action port [ 725.153071] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76f74d16-9031-4472-a81b-f9ada0520a34 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.153071] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76f74d16-9031-4472-a81b-f9ada0520a34" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.153725] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76f74d16-9031-4472-a81b-f9ada0520a34" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.153725] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76f74d16-9031-4472-a81b-f9ada0520a34" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.153725] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76f74d16-9031-4472-a81b-f9ada0520a34',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.154452] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-76f74d16-9031-4472-a81b-f9ada0520a34 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.154541] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76f74d16-9031-4472-a81b-f9ada0520a34" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.154611] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76f74d16-9031-4472-a81b-f9ada0520a34" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.154778] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76f74d16-9031-4472-a81b-f9ada0520a34" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.154927] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.155330] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.158264] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.158264] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.158264] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.158264] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76f74d16-9031-4472-a81b-f9ada0520a34',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.158264] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-21de7d01-c998-4ca7-b466-d6a19ba60e8c taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.158264] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21de7d01-c998-4ca7-b466-d6a19ba60e8c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.158264] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21de7d01-c998-4ca7-b466-d6a19ba60e8c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.158264] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21de7d01-c998-4ca7-b466-d6a19ba60e8c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.158264] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21de7d01-c998-4ca7-b466-d6a19ba60e8c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.658735] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-76f74d16-9031-4472-a81b-f9ada0520a34 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.658866] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76f74d16-9031-4472-a81b-f9ada0520a34" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.659074] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('76f74d16-9031-4472-a81b-f9ada0520a34',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.659967] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 21de7d01-c998-4ca7-b466-d6a19ba60e8c with status ACTIVE [ 725.660175] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.660272] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.660335] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.660536] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.660626] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.660790] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.660879] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.660936] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.661095] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.661165] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.661344] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.661447] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.661504] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.661640] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.661708] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.661784] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 21de7d01-c998-4ca7-b466-d6a19ba60e8c is going to be updated. [ 725.684883] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.685119] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.685201] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.685441] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.685584] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.685746] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21de7d01-c998-4ca7-b466-d6a19ba60e8c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.163929] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('76f74d16-9031-4472-a81b-f9ada0520a34',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.580463] env[68328]: INFO networking_nsxv3.common.synchronization [req-6d688fa5-240f-44f0-b662-71e82fc93f30 req-d33e2b1a-f793-4fbf-89cb-ece362b18a46 tempest-SecurityGroupsTestJSON-429138018 tempest-SecurityGroupsTestJSON-429138018-project-member] Enqueued Resource ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 with Priority: HIGHEST for action security_group_members [ 726.580777] env[68328]: INFO networking_nsxv3.common.synchronization [req-6d688fa5-240f-44f0-b662-71e82fc93f30 req-d33e2b1a-f793-4fbf-89cb-ece362b18a46 tempest-SecurityGroupsTestJSON-429138018 tempest-SecurityGroupsTestJSON-429138018-project-member] Enqueued Resource ID: 8f95f28e-3c21-415e-9067-7aef8eff10d3 with Priority: HIGHEST for action security_group_members [ 726.581609] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 with Priority: HIGHEST for action security_group_members [ 726.583965] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f95f28e-3c21-415e-9067-7aef8eff10d3 with Priority: HIGHEST for action security_group_members [ 726.584640] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-870ec36b-ba1d-4422-a26d-1328f51f79e4 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.584816] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.584916] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.585243] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.585448] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.585599] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.585698] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.585908] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.587548] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.587754] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.588859] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f95f28e-3c21-415e-9067-7aef8eff10d3 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.591824] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f95f28e-3c21-415e-9067-7aef8eff10d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.591904] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f95f28e-3c21-415e-9067-7aef8eff10d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.592215] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f95f28e-3c21-415e-9067-7aef8eff10d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.592460] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.592627] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.592745] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.593045] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.593117] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.593270] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f95f28e-3c21-415e-9067-7aef8eff10d3',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.634229] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55dff300-131a-42f9-920d-f2b5a3b91449 in Status: SUCCESS [ 726.634229] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.663092] env[68328]: INFO networking_nsxv3.common.synchronization [None req-780a3c9a-0c9d-4401-9ba2-ca5d62b43958 None None] Enqueued Resource ID: 43fb72da-dea1-4bad-8727-4edf721f61bc with Priority: HIGHEST for action port [ 726.663342] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43fb72da-dea1-4bad-8727-4edf721f61bc with Priority: HIGHEST for action port [ 726.664083] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-43fb72da-dea1-4bad-8727-4edf721f61bc taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.664203] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43fb72da-dea1-4bad-8727-4edf721f61bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.664258] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43fb72da-dea1-4bad-8727-4edf721f61bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.664501] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43fb72da-dea1-4bad-8727-4edf721f61bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.664578] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43fb72da-dea1-4bad-8727-4edf721f61bc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.667263] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.667345] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.667345] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.667748] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.667821] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.667899] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76f74d16-9031-4472-a81b-f9ada0520a34 is going to be created. [ 726.688661] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.688800] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.688871] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.689102] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.689270] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.699687] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76f74d16-9031-4472-a81b-f9ada0520a34 in Status: UNINITIALIZED for 2s [ 726.726276] env[68328]: INFO networking_nsxv3.common.synchronization [req-6d688fa5-240f-44f0-b662-71e82fc93f30 req-d33e2b1a-f793-4fbf-89cb-ece362b18a46 tempest-SecurityGroupsTestJSON-429138018 tempest-SecurityGroupsTestJSON-429138018-project-member] Enqueued Resource ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 with Priority: HIGHEST for action security_group_rules [ 726.726537] env[68328]: INFO networking_nsxv3.common.synchronization [req-6d688fa5-240f-44f0-b662-71e82fc93f30 req-d33e2b1a-f793-4fbf-89cb-ece362b18a46 tempest-SecurityGroupsTestJSON-429138018 tempest-SecurityGroupsTestJSON-429138018-project-member] Enqueued Resource ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 with Priority: HIGHEST for action security_group_members [ 726.726739] env[68328]: INFO networking_nsxv3.common.synchronization [req-6d688fa5-240f-44f0-b662-71e82fc93f30 req-d33e2b1a-f793-4fbf-89cb-ece362b18a46 tempest-SecurityGroupsTestJSON-429138018 tempest-SecurityGroupsTestJSON-429138018-project-member] Enqueued Resource ID: 8f95f28e-3c21-415e-9067-7aef8eff10d3 with Priority: HIGHEST for action security_group_rules [ 726.726914] env[68328]: INFO networking_nsxv3.common.synchronization [req-6d688fa5-240f-44f0-b662-71e82fc93f30 req-d33e2b1a-f793-4fbf-89cb-ece362b18a46 tempest-SecurityGroupsTestJSON-429138018 tempest-SecurityGroupsTestJSON-429138018-project-member] Enqueued Resource ID: 8f95f28e-3c21-415e-9067-7aef8eff10d3 with Priority: HIGHEST for action security_group_members [ 726.727095] env[68328]: INFO networking_nsxv3.common.synchronization [req-6d688fa5-240f-44f0-b662-71e82fc93f30 req-d33e2b1a-f793-4fbf-89cb-ece362b18a46 tempest-SecurityGroupsTestJSON-429138018 tempest-SecurityGroupsTestJSON-429138018-project-member] Enqueued Resource ID: f3d28b00-a4b9-4d07-8f89-ca4bfef187a2 with Priority: HIGHEST for action port [ 726.727619] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 with Priority: HIGHEST for action security_group_rules [ 726.727768] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f95f28e-3c21-415e-9067-7aef8eff10d3 with Priority: HIGHEST for action security_group_rules [ 726.727884] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3d28b00-a4b9-4d07-8f89-ca4bfef187a2 with Priority: HIGHEST for action port [ 726.727988] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 with Priority: HIGHEST for action security_group_members [ 726.728817] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f95f28e-3c21-415e-9067-7aef8eff10d3 with Priority: HIGHEST for action security_group_members [ 726.729151] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-870ec36b-ba1d-4422-a26d-1328f51f79e4 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.729297] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.729370] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.729598] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.729697] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.730575] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f95f28e-3c21-415e-9067-7aef8eff10d3 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.730721] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f95f28e-3c21-415e-9067-7aef8eff10d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.730894] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f95f28e-3c21-415e-9067-7aef8eff10d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.731156] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f95f28e-3c21-415e-9067-7aef8eff10d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.731247] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f95f28e-3c21-415e-9067-7aef8eff10d3',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.732171] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3d28b00-a4b9-4d07-8f89-ca4bfef187a2 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.732284] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3d28b00-a4b9-4d07-8f89-ca4bfef187a2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.732367] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3d28b00-a4b9-4d07-8f89-ca4bfef187a2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.732574] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3d28b00-a4b9-4d07-8f89-ca4bfef187a2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.732669] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3d28b00-a4b9-4d07-8f89-ca4bfef187a2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.733652] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-870ec36b-ba1d-4422-a26d-1328f51f79e4 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.733758] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.734045] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f95f28e-3c21-415e-9067-7aef8eff10d3 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.734127] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f95f28e-3c21-415e-9067-7aef8eff10d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.097852] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.097852] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f95f28e-3c21-415e-9067-7aef8eff10d3',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.168199] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 43fb72da-dea1-4bad-8727-4edf721f61bc [ 727.168199] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.168199] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.168199] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.168199] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.168199] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.168199] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:43fb72da-dea1-4bad-8727-4edf721f61bc already deleted. [ 727.168199] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43fb72da-dea1-4bad-8727-4edf721f61bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.239281] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f3d28b00-a4b9-4d07-8f89-ca4bfef187a2 with status ACTIVE [ 727.239281] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.239281] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.239281] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.239281] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.239281] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.239281] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.239281] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.239281] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.239281] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.239281] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.239281] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.239281] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.239281] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.239281] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.239281] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.239281] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f3d28b00-a4b9-4d07-8f89-ca4bfef187a2 is going to be updated. [ 727.241546] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f95f28e-3c21-415e-9067-7aef8eff10d3 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.241861] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f95f28e-3c21-415e-9067-7aef8eff10d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.242264] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-870ec36b-ba1d-4422-a26d-1328f51f79e4 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.242501] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.266643] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.266806] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.267687] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.267687] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.267687] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.267687] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3d28b00-a4b9-4d07-8f89-ca4bfef187a2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.600409] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f95f28e-3c21-415e-9067-7aef8eff10d3',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.601800] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.000410] env[68328]: INFO networking_nsxv3.common.synchronization [req-133e38f0-8b07-422f-bb74-2932fa1c554b req-76d29373-afb3-4752-aca3-5a5806dc674c tempest-SecurityGroupsTestJSON-429138018 tempest-SecurityGroupsTestJSON-429138018-project-member] Enqueued Resource ID: c897dadb-95bc-4de7-a117-d38870fbace8 with Priority: HIGHEST for action security_group_members [ 728.000612] env[68328]: INFO networking_nsxv3.common.synchronization [req-133e38f0-8b07-422f-bb74-2932fa1c554b req-76d29373-afb3-4752-aca3-5a5806dc674c tempest-SecurityGroupsTestJSON-429138018 tempest-SecurityGroupsTestJSON-429138018-project-member] Enqueued Resource ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 with Priority: HIGHEST for action security_group_members [ 728.000750] env[68328]: INFO networking_nsxv3.common.synchronization [req-133e38f0-8b07-422f-bb74-2932fa1c554b req-76d29373-afb3-4752-aca3-5a5806dc674c tempest-SecurityGroupsTestJSON-429138018 tempest-SecurityGroupsTestJSON-429138018-project-member] Enqueued Resource ID: 8f95f28e-3c21-415e-9067-7aef8eff10d3 with Priority: HIGHEST for action security_group_members [ 728.003863] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c897dadb-95bc-4de7-a117-d38870fbace8 with Priority: HIGHEST for action security_group_members [ 728.003986] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 with Priority: HIGHEST for action security_group_members [ 728.004119] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f95f28e-3c21-415e-9067-7aef8eff10d3 with Priority: HIGHEST for action security_group_members [ 728.004487] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-c897dadb-95bc-4de7-a117-d38870fbace8 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.004620] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c897dadb-95bc-4de7-a117-d38870fbace8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.004687] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c897dadb-95bc-4de7-a117-d38870fbace8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.004946] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c897dadb-95bc-4de7-a117-d38870fbace8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.005123] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.005238] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.005303] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.005463] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.005550] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.005647] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c897dadb-95bc-4de7-a117-d38870fbace8',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.007258] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-870ec36b-ba1d-4422-a26d-1328f51f79e4 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.007364] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.007612] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f95f28e-3c21-415e-9067-7aef8eff10d3 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.007882] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f95f28e-3c21-415e-9067-7aef8eff10d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.103136] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.103458] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.103538] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.103783] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.103916] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.104034] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f95f28e-3c21-415e-9067-7aef8eff10d3 is going to be created. [ 728.105337] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.105477] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.105528] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.105676] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.105754] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.105840] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 is going to be updated. [ 728.126852] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.127010] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.127091] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.127274] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.127432] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.132507] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.132668] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.132722] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.133489] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.133489] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.136992] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f95f28e-3c21-415e-9067-7aef8eff10d3 in Status: UNINITIALIZED for 2s [ 728.140468] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 in Status: IN_PROGRESS for 2s [ 728.167243] env[68328]: INFO networking_nsxv3.common.synchronization [req-133e38f0-8b07-422f-bb74-2932fa1c554b req-76d29373-afb3-4752-aca3-5a5806dc674c tempest-SecurityGroupsTestJSON-429138018 tempest-SecurityGroupsTestJSON-429138018-project-member] Enqueued Resource ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 with Priority: HIGHEST for action security_group_rules [ 728.167354] env[68328]: INFO networking_nsxv3.common.synchronization [req-133e38f0-8b07-422f-bb74-2932fa1c554b req-76d29373-afb3-4752-aca3-5a5806dc674c tempest-SecurityGroupsTestJSON-429138018 tempest-SecurityGroupsTestJSON-429138018-project-member] Enqueued Resource ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 with Priority: HIGHEST for action security_group_members [ 728.167490] env[68328]: INFO networking_nsxv3.common.synchronization [req-133e38f0-8b07-422f-bb74-2932fa1c554b req-76d29373-afb3-4752-aca3-5a5806dc674c tempest-SecurityGroupsTestJSON-429138018 tempest-SecurityGroupsTestJSON-429138018-project-member] Enqueued Resource ID: 8f95f28e-3c21-415e-9067-7aef8eff10d3 with Priority: HIGHEST for action security_group_rules [ 728.167824] env[68328]: INFO networking_nsxv3.common.synchronization [req-133e38f0-8b07-422f-bb74-2932fa1c554b req-76d29373-afb3-4752-aca3-5a5806dc674c tempest-SecurityGroupsTestJSON-429138018 tempest-SecurityGroupsTestJSON-429138018-project-member] Enqueued Resource ID: 8f95f28e-3c21-415e-9067-7aef8eff10d3 with Priority: HIGHEST for action security_group_members [ 728.167824] env[68328]: INFO networking_nsxv3.common.synchronization [req-133e38f0-8b07-422f-bb74-2932fa1c554b req-76d29373-afb3-4752-aca3-5a5806dc674c tempest-SecurityGroupsTestJSON-429138018 tempest-SecurityGroupsTestJSON-429138018-project-member] Enqueued Resource ID: c897dadb-95bc-4de7-a117-d38870fbace8 with Priority: HIGHEST for action security_group_rules [ 728.167942] env[68328]: INFO networking_nsxv3.common.synchronization [req-133e38f0-8b07-422f-bb74-2932fa1c554b req-76d29373-afb3-4752-aca3-5a5806dc674c tempest-SecurityGroupsTestJSON-429138018 tempest-SecurityGroupsTestJSON-429138018-project-member] Enqueued Resource ID: c897dadb-95bc-4de7-a117-d38870fbace8 with Priority: HIGHEST for action security_group_members [ 728.167984] env[68328]: INFO networking_nsxv3.common.synchronization [req-133e38f0-8b07-422f-bb74-2932fa1c554b req-76d29373-afb3-4752-aca3-5a5806dc674c tempest-SecurityGroupsTestJSON-429138018 tempest-SecurityGroupsTestJSON-429138018-project-member] Enqueued Resource ID: f3d28b00-a4b9-4d07-8f89-ca4bfef187a2 with Priority: HIGHEST for action port [ 728.168454] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 with Priority: HIGHEST for action security_group_rules [ 728.168684] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f95f28e-3c21-415e-9067-7aef8eff10d3 with Priority: HIGHEST for action security_group_rules [ 728.168684] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c897dadb-95bc-4de7-a117-d38870fbace8 with Priority: HIGHEST for action security_group_members [ 728.168769] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3d28b00-a4b9-4d07-8f89-ca4bfef187a2 with Priority: HIGHEST for action port [ 728.168846] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c897dadb-95bc-4de7-a117-d38870fbace8 with Priority: HIGHEST for action security_group_rules [ 728.168933] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 with Priority: HIGHEST for action security_group_members [ 728.169654] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f95f28e-3c21-415e-9067-7aef8eff10d3 with Priority: HIGHEST for action security_group_members [ 728.169654] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-870ec36b-ba1d-4422-a26d-1328f51f79e4 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.169654] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.169831] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f95f28e-3c21-415e-9067-7aef8eff10d3 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.169831] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f95f28e-3c21-415e-9067-7aef8eff10d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.169948] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-c897dadb-95bc-4de7-a117-d38870fbace8 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.170040] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c897dadb-95bc-4de7-a117-d38870fbace8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.170220] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3d28b00-a4b9-4d07-8f89-ca4bfef187a2 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.170319] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3d28b00-a4b9-4d07-8f89-ca4bfef187a2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.170380] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3d28b00-a4b9-4d07-8f89-ca4bfef187a2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.170577] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3d28b00-a4b9-4d07-8f89-ca4bfef187a2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.170716] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3d28b00-a4b9-4d07-8f89-ca4bfef187a2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.171803] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c897dadb-95bc-4de7-a117-d38870fbace8 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.171984] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c897dadb-95bc-4de7-a117-d38870fbace8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.171984] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c897dadb-95bc-4de7-a117-d38870fbace8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.172205] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c897dadb-95bc-4de7-a117-d38870fbace8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.172292] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c897dadb-95bc-4de7-a117-d38870fbace8',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.172995] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-870ec36b-ba1d-4422-a26d-1328f51f79e4 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.174069] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.174069] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f95f28e-3c21-415e-9067-7aef8eff10d3 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.174069] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f95f28e-3c21-415e-9067-7aef8eff10d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.280527] env[68328]: INFO networking_nsxv3.common.synchronization [req-9a061179-9543-47fd-838f-8b8ad5915d1e req-7d27f7e3-60e4-4cbe-a777-de0096c6e029 tempest-ServerActionsV293TestJSON-674787330 tempest-ServerActionsV293TestJSON-674787330-project-member] Enqueued Resource ID: 24a59c7c-3185-4ae4-af15-7deeba4a037c with Priority: HIGHEST for action security_group_members [ 728.281742] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24a59c7c-3185-4ae4-af15-7deeba4a037c with Priority: HIGHEST for action security_group_members [ 728.282148] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-24a59c7c-3185-4ae4-af15-7deeba4a037c taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.282344] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24a59c7c-3185-4ae4-af15-7deeba4a037c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.282344] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24a59c7c-3185-4ae4-af15-7deeba4a037c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.283744] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24a59c7c-3185-4ae4-af15-7deeba4a037c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.283744] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.283744] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.283744] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.283744] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.283744] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.283744] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24a59c7c-3185-4ae4-af15-7deeba4a037c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.509459] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c897dadb-95bc-4de7-a117-d38870fbace8',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.674425] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f3d28b00-a4b9-4d07-8f89-ca4bfef187a2 with status ACTIVE [ 728.674683] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.674812] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.674878] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.675140] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.675239] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.675432] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.675534] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.675597] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.675753] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.675830] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.676023] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.676141] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.676205] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.676349] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.676421] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.676506] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f3d28b00-a4b9-4d07-8f89-ca4bfef187a2 is going to be updated. [ 728.677750] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-c897dadb-95bc-4de7-a117-d38870fbace8 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.677852] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c897dadb-95bc-4de7-a117-d38870fbace8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.701017] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.701017] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.701017] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.701017] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.701017] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.701017] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3d28b00-a4b9-4d07-8f89-ca4bfef187a2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.707302] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76f74d16-9031-4472-a81b-f9ada0520a34 in Status: SUCCESS [ 728.707506] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76f74d16-9031-4472-a81b-f9ada0520a34" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.707667] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76f74d16-9031-4472-a81b-f9ada0520a34" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.707866] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76f74d16-9031-4472-a81b-f9ada0520a34" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.708552] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.708552] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.708552] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.708552] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.708552] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.708552] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76f74d16-9031-4472-a81b-f9ada0520a34" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.708848] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('76f74d16-9031-4472-a81b-f9ada0520a34',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.787960] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.787960] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.787960] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.787960] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.787960] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.787960] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.787960] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.787960] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.787960] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.787960] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.787960] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24a59c7c-3185-4ae4-af15-7deeba4a037c already deleted. [ 728.787960] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24a59c7c-3185-4ae4-af15-7deeba4a037c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.836153] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-164 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.836153] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-164" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.836153] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-164" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.836153] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-164" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.836153] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.836153] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.836153] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.836153] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.836153] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.836153] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 728.837284] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 728.837699] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 728.837699] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 728.837786] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 728.837853] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 728.837991] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 728.860983] env[68328]: INFO networking_nsxv3.common.synchronization [None req-79dd5b88-119e-4b6b-9b45-0a09359ddceb None None] Enqueued Resource ID: ac38f815-d038-4c7f-a6b5-c2143d03354b with Priority: HIGHEST for action port [ 728.861271] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac38f815-d038-4c7f-a6b5-c2143d03354b with Priority: HIGHEST for action port [ 728.861798] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac38f815-d038-4c7f-a6b5-c2143d03354b taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.861922] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac38f815-d038-4c7f-a6b5-c2143d03354b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.861991] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac38f815-d038-4c7f-a6b5-c2143d03354b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.862577] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac38f815-d038-4c7f-a6b5-c2143d03354b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.862701] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac38f815-d038-4c7f-a6b5-c2143d03354b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.865483] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 728.865700] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 728.865873] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 728.866099] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-164" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.866821] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-3fcdc46d-e4f0-4ee5-abbb-4fed67e61730 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.867361] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-3fcdc46d-e4f0-4ee5-abbb-4fed67e61730" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.867361] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-3fcdc46d-e4f0-4ee5-abbb-4fed67e61730" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.867515] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-3fcdc46d-e4f0-4ee5-abbb-4fed67e61730" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.867724] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3fcdc46d-e4f0-4ee5-abbb-4fed67e61730',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.013050] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c897dadb-95bc-4de7-a117-d38870fbace8',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.212156] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('76f74d16-9031-4472-a81b-f9ada0520a34',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.364668] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ac38f815-d038-4c7f-a6b5-c2143d03354b [ 729.364905] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.365045] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.365111] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.365345] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.365437] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.365530] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ac38f815-d038-4c7f-a6b5-c2143d03354b already deleted. [ 729.365608] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac38f815-d038-4c7f-a6b5-c2143d03354b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.370474] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.371203] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.371203] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.371203] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.371370] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.371403] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 3fcdc46d-e4f0-4ee5-abbb-4fed67e61730 not found, creating... [ 729.372093] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.372093] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.372093] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.372234] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.372269] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.372544] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.372690] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.372831] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.373051] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.373188] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.373354] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 3fcdc46d-e4f0-4ee5-abbb-4fed67e61730 is going to be created. [ 729.393869] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.394105] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.395312] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.397170] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.397170] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.397170] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-3fcdc46d-e4f0-4ee5-abbb-4fed67e61730" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.515590] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.515700] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.515745] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.515961] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.516068] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.516174] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c897dadb-95bc-4de7-a117-d38870fbace8 is going to be created. [ 729.538413] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.538607] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.538673] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.538872] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.539040] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.552653] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c897dadb-95bc-4de7-a117-d38870fbace8 in Status: UNINITIALIZED for 2s [ 729.717015] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 76f74d16-9031-4472-a81b-f9ada0520a34: rpc.has_security_group_logging(os_id): False [ 729.733775] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.733960] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.734024] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.734245] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.734331] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.734579] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.734695] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.734732] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.734876] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.734945] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.735040] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76f74d16-9031-4472-a81b-f9ada0520a34 is going to be created. [ 729.791339] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.792228] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.792331] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.792559] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.792737] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.802892] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76f74d16-9031-4472-a81b-f9ada0520a34 in Status: IN_PROGRESS for 2s [ 730.151733] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f95f28e-3c21-415e-9067-7aef8eff10d3 in Status: SUCCESS [ 730.151822] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f95f28e-3c21-415e-9067-7aef8eff10d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.153256] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 in Status: SUCCESS [ 730.153256] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.153256] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f95f28e-3c21-415e-9067-7aef8eff10d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.153256] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f95f28e-3c21-415e-9067-7aef8eff10d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.153256] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.153685] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.153685] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.153685] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.153685] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.153795] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f95f28e-3c21-415e-9067-7aef8eff10d3',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.155216] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.155387] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.155551] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.155657] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.159074] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.159302] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.159400] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.159502] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.336152] env[68328]: INFO networking_nsxv3.common.synchronization [req-9a061179-9543-47fd-838f-8b8ad5915d1e req-5c7520c2-680b-403d-a38f-c4e27844fc10 service nova] Enqueued Resource ID: 24a59c7c-3185-4ae4-af15-7deeba4a037c with Priority: HIGHEST for action security_group_rules [ 730.336396] env[68328]: INFO networking_nsxv3.common.synchronization [req-9a061179-9543-47fd-838f-8b8ad5915d1e req-5c7520c2-680b-403d-a38f-c4e27844fc10 service nova] Enqueued Resource ID: 24a59c7c-3185-4ae4-af15-7deeba4a037c with Priority: HIGHEST for action security_group_members [ 730.336769] env[68328]: INFO networking_nsxv3.common.synchronization [req-9a061179-9543-47fd-838f-8b8ad5915d1e req-5c7520c2-680b-403d-a38f-c4e27844fc10 service nova] Enqueued Resource ID: 3fcdc46d-e4f0-4ee5-abbb-4fed67e61730 with Priority: HIGHEST for action port [ 730.337086] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24a59c7c-3185-4ae4-af15-7deeba4a037c with Priority: HIGHEST for action security_group_rules [ 730.337280] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24a59c7c-3185-4ae4-af15-7deeba4a037c with Priority: HIGHEST for action security_group_members [ 730.337417] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fcdc46d-e4f0-4ee5-abbb-4fed67e61730 with Priority: HIGHEST for action port [ 730.340841] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24a59c7c-3185-4ae4-af15-7deeba4a037c taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.340841] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24a59c7c-3185-4ae4-af15-7deeba4a037c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.340841] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24a59c7c-3185-4ae4-af15-7deeba4a037c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.340841] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24a59c7c-3185-4ae4-af15-7deeba4a037c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.340841] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24a59c7c-3185-4ae4-af15-7deeba4a037c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.340841] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-24a59c7c-3185-4ae4-af15-7deeba4a037c taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.340841] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24a59c7c-3185-4ae4-af15-7deeba4a037c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.340841] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24a59c7c-3185-4ae4-af15-7deeba4a037c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.340841] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24a59c7c-3185-4ae4-af15-7deeba4a037c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.340841] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.340841] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.340841] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.340841] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.340841] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.340841] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24a59c7c-3185-4ae4-af15-7deeba4a037c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.341448] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-3fcdc46d-e4f0-4ee5-abbb-4fed67e61730 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.341448] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3fcdc46d-e4f0-4ee5-abbb-4fed67e61730" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.341753] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3fcdc46d-e4f0-4ee5-abbb-4fed67e61730" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.341753] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3fcdc46d-e4f0-4ee5-abbb-4fed67e61730" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.341933] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3fcdc46d-e4f0-4ee5-abbb-4fed67e61730',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.656189] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f95f28e-3c21-415e-9067-7aef8eff10d3',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.663370] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.761648] env[68328]: INFO networking_nsxv3.common.synchronization [None req-da47596c-8cfb-4b60-9216-a5ac51fc46e1 None None] Enqueued Resource ID: b5ea11a5-dc23-4c93-b9a2-621a2b84fd86 with Priority: HIGHEST for action port [ 730.762792] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5ea11a5-dc23-4c93-b9a2-621a2b84fd86 with Priority: HIGHEST for action port [ 730.763438] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5ea11a5-dc23-4c93-b9a2-621a2b84fd86 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.763612] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5ea11a5-dc23-4c93-b9a2-621a2b84fd86" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.763704] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5ea11a5-dc23-4c93-b9a2-621a2b84fd86" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.763979] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5ea11a5-dc23-4c93-b9a2-621a2b84fd86" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.764202] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5ea11a5-dc23-4c93-b9a2-621a2b84fd86',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.844124] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('24a59c7c-3185-4ae4-af15-7deeba4a037c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.845798] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-24a59c7c-3185-4ae4-af15-7deeba4a037c taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.845938] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24a59c7c-3185-4ae4-af15-7deeba4a037c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.847173] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3fcdc46d-e4f0-4ee5-abbb-4fed67e61730 with status ACTIVE [ 730.847173] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.847173] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.847173] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.847173] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.847173] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.847173] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.847437] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.847604] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.847710] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.847743] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.847927] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.848032] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.848093] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.848531] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.848531] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.848531] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3fcdc46d-e4f0-4ee5-abbb-4fed67e61730 is going to be updated. [ 730.872415] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.872415] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.872415] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.872415] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.872415] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.872415] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3fcdc46d-e4f0-4ee5-abbb-4fed67e61730" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.009991] env[68328]: INFO networking_nsxv3.common.synchronization [req-81417033-1f69-4dd2-a1c7-f01589249c78 req-d17f4bd1-75f7-422c-b58b-e29f55a3a4e2 tempest-ServersV294TestFqdnHostnames-1189707928 tempest-ServersV294TestFqdnHostnames-1189707928-project-member] Enqueued Resource ID: 14cff10c-171f-4bbf-8531-6de5c6c7cc48 with Priority: HIGHEST for action security_group_members [ 731.010523] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14cff10c-171f-4bbf-8531-6de5c6c7cc48 with Priority: HIGHEST for action security_group_members [ 731.010809] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-14cff10c-171f-4bbf-8531-6de5c6c7cc48 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.012263] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14cff10c-171f-4bbf-8531-6de5c6c7cc48" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.012263] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14cff10c-171f-4bbf-8531-6de5c6c7cc48" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.014026] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14cff10c-171f-4bbf-8531-6de5c6c7cc48" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.014026] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.014142] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.018014] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.018014] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.018014] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.018014] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14cff10c-171f-4bbf-8531-6de5c6c7cc48',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.158181] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f95f28e-3c21-415e-9067-7aef8eff10d3',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.166813] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.266746] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b5ea11a5-dc23-4c93-b9a2-621a2b84fd86 [ 731.266995] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.267146] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.267218] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.267451] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.267804] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.267804] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b5ea11a5-dc23-4c93-b9a2-621a2b84fd86 already deleted. [ 731.267804] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5ea11a5-dc23-4c93-b9a2-621a2b84fd86" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.319480] env[68328]: INFO networking_nsxv3.common.synchronization [None req-e6cca631-9333-46a6-9b43-7fad314052b0 None None] Enqueued Resource ID: a85513b6-430f-4d2c-8290-562f183b26fd with Priority: HIGHEST for action port [ 731.319480] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a85513b6-430f-4d2c-8290-562f183b26fd with Priority: HIGHEST for action port [ 731.319480] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-a85513b6-430f-4d2c-8290-562f183b26fd taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.319480] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a85513b6-430f-4d2c-8290-562f183b26fd" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.319480] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a85513b6-430f-4d2c-8290-562f183b26fd" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.319660] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a85513b6-430f-4d2c-8290-562f183b26fd" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.319660] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a85513b6-430f-4d2c-8290-562f183b26fd',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.353634] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('24a59c7c-3185-4ae4-af15-7deeba4a037c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.518178] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.518579] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.518579] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.518677] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.518723] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.518927] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.519036] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.519098] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.519275] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.519352] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.519437] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14cff10c-171f-4bbf-8531-6de5c6c7cc48 already deleted. [ 731.519512] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14cff10c-171f-4bbf-8531-6de5c6c7cc48" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.565305] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c897dadb-95bc-4de7-a117-d38870fbace8 in Status: SUCCESS [ 731.565305] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c897dadb-95bc-4de7-a117-d38870fbace8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.565305] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c897dadb-95bc-4de7-a117-d38870fbace8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.565305] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c897dadb-95bc-4de7-a117-d38870fbace8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.565305] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.565305] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.565305] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.565517] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.565517] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.565649] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c897dadb-95bc-4de7-a117-d38870fbace8',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.662627] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.662786] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.662860] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.663089] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.663185] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.663285] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f95f28e-3c21-415e-9067-7aef8eff10d3 is going to be updated. [ 731.669211] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.669389] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.669439] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.669657] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.669749] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.669848] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 is going to be updated. [ 731.694095] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.694095] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.694095] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.694357] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.694594] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.696503] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.696644] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.696693] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.696919] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.697169] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.707993] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f95f28e-3c21-415e-9067-7aef8eff10d3 in Status: IN_PROGRESS for 2s [ 731.709057] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 in Status: IN_PROGRESS for 2s [ 731.817782] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76f74d16-9031-4472-a81b-f9ada0520a34 in Status: SUCCESS [ 731.817782] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76f74d16-9031-4472-a81b-f9ada0520a34" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.822207] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a85513b6-430f-4d2c-8290-562f183b26fd [ 731.822446] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.822577] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.822644] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.822848] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.822929] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.823037] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a85513b6-430f-4d2c-8290-562f183b26fd already deleted. [ 731.823119] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a85513b6-430f-4d2c-8290-562f183b26fd" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.855681] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.855832] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.855899] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.856132] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.856219] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.856315] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24a59c7c-3185-4ae4-af15-7deeba4a037c is going to be created. [ 731.879085] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.879274] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.879501] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.879700] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.879700] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.887679] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-796 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.887877] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-796" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.888008] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-796" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.888339] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-796" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.888581] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.888801] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.888852] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.889974] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.890067] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.890290] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 731.890405] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 731.890764] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 731.890764] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 731.890764] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 731.890944] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 731.891055] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 731.894264] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24a59c7c-3185-4ae4-af15-7deeba4a037c in Status: UNINITIALIZED for 2s [ 731.915411] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 731.915578] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 731.915716] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 731.915892] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-796" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.916237] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-306144f0-8e53-4a90-99aa-6dc53e27812f taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.916406] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-306144f0-8e53-4a90-99aa-6dc53e27812f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.916584] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-306144f0-8e53-4a90-99aa-6dc53e27812f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.916848] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-306144f0-8e53-4a90-99aa-6dc53e27812f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.916986] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('306144f0-8e53-4a90-99aa-6dc53e27812f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.069625] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c897dadb-95bc-4de7-a117-d38870fbace8',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.422050] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.422050] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.422050] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.422050] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.422050] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.422050] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 306144f0-8e53-4a90-99aa-6dc53e27812f not found, creating... [ 732.422050] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.422050] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.422050] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.422050] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.422050] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.422581] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.422581] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.422581] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.423562] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.423854] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.424144] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 306144f0-8e53-4a90-99aa-6dc53e27812f is going to be created. [ 732.444175] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.444175] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.444175] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.444175] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.444175] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.444175] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-306144f0-8e53-4a90-99aa-6dc53e27812f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.572347] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c897dadb-95bc-4de7-a117-d38870fbace8',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.075019] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.075176] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.075322] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.075503] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.075587] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.075684] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c897dadb-95bc-4de7-a117-d38870fbace8 is going to be updated. [ 733.099772] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.100038] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.100038] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.100243] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.100387] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.108702] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c897dadb-95bc-4de7-a117-d38870fbace8 in Status: IN_PROGRESS for 2s [ 733.158142] env[68328]: INFO networking_nsxv3.common.synchronization [None req-a65a05e4-6ea0-46ab-baf8-99f390c988e2 None None] Enqueued Resource ID: 915246c9-5af6-429f-9bd6-ff141f47eb36 with Priority: HIGHEST for action port [ 733.158789] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 915246c9-5af6-429f-9bd6-ff141f47eb36 with Priority: HIGHEST for action port [ 733.159044] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-915246c9-5af6-429f-9bd6-ff141f47eb36 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.159203] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-915246c9-5af6-429f-9bd6-ff141f47eb36" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.159288] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-915246c9-5af6-429f-9bd6-ff141f47eb36" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.159555] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-915246c9-5af6-429f-9bd6-ff141f47eb36" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.159748] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('915246c9-5af6-429f-9bd6-ff141f47eb36',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.184592] env[68328]: INFO networking_nsxv3.common.synchronization [req-81417033-1f69-4dd2-a1c7-f01589249c78 req-4bc06d81-d52a-4661-8c38-49269913145d service nova] Enqueued Resource ID: 14cff10c-171f-4bbf-8531-6de5c6c7cc48 with Priority: HIGHEST for action security_group_rules [ 733.187022] env[68328]: INFO networking_nsxv3.common.synchronization [req-81417033-1f69-4dd2-a1c7-f01589249c78 req-4bc06d81-d52a-4661-8c38-49269913145d service nova] Enqueued Resource ID: 14cff10c-171f-4bbf-8531-6de5c6c7cc48 with Priority: HIGHEST for action security_group_members [ 733.187022] env[68328]: INFO networking_nsxv3.common.synchronization [req-81417033-1f69-4dd2-a1c7-f01589249c78 req-4bc06d81-d52a-4661-8c38-49269913145d service nova] Enqueued Resource ID: 306144f0-8e53-4a90-99aa-6dc53e27812f with Priority: HIGHEST for action port [ 733.187022] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14cff10c-171f-4bbf-8531-6de5c6c7cc48 with Priority: HIGHEST for action security_group_rules [ 733.187022] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14cff10c-171f-4bbf-8531-6de5c6c7cc48 with Priority: HIGHEST for action security_group_members [ 733.187022] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 306144f0-8e53-4a90-99aa-6dc53e27812f with Priority: HIGHEST for action port [ 733.187022] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14cff10c-171f-4bbf-8531-6de5c6c7cc48 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.187022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14cff10c-171f-4bbf-8531-6de5c6c7cc48" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.187022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14cff10c-171f-4bbf-8531-6de5c6c7cc48" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.187022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14cff10c-171f-4bbf-8531-6de5c6c7cc48" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.187022] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14cff10c-171f-4bbf-8531-6de5c6c7cc48',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.188601] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-14cff10c-171f-4bbf-8531-6de5c6c7cc48 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.188881] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14cff10c-171f-4bbf-8531-6de5c6c7cc48" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.189590] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14cff10c-171f-4bbf-8531-6de5c6c7cc48" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.189590] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14cff10c-171f-4bbf-8531-6de5c6c7cc48" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.189590] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.189590] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.189764] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.189792] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.189891] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.189967] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14cff10c-171f-4bbf-8531-6de5c6c7cc48',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.191259] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-306144f0-8e53-4a90-99aa-6dc53e27812f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.191374] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-306144f0-8e53-4a90-99aa-6dc53e27812f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.191489] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-306144f0-8e53-4a90-99aa-6dc53e27812f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.191578] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-306144f0-8e53-4a90-99aa-6dc53e27812f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.191656] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('306144f0-8e53-4a90-99aa-6dc53e27812f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.663837] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 915246c9-5af6-429f-9bd6-ff141f47eb36 [ 733.663837] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.663837] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.663837] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.664253] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.664253] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.664253] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:915246c9-5af6-429f-9bd6-ff141f47eb36 already deleted. [ 733.664253] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-915246c9-5af6-429f-9bd6-ff141f47eb36" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.693739] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('14cff10c-171f-4bbf-8531-6de5c6c7cc48',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.694857] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-14cff10c-171f-4bbf-8531-6de5c6c7cc48 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.695046] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14cff10c-171f-4bbf-8531-6de5c6c7cc48" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.695279] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 306144f0-8e53-4a90-99aa-6dc53e27812f with status ACTIVE [ 733.695451] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.695560] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.695680] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.695820] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.695932] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.696062] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.696155] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.696208] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.696358] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.696434] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.696606] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.696722] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.696748] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.696880] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.696972] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.697034] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 306144f0-8e53-4a90-99aa-6dc53e27812f is going to be updated. [ 733.716048] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.716828] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.716828] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.716828] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.716828] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.716828] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-306144f0-8e53-4a90-99aa-6dc53e27812f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.720230] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f95f28e-3c21-415e-9067-7aef8eff10d3 in Status: SUCCESS [ 733.721039] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f95f28e-3c21-415e-9067-7aef8eff10d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.721309] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 in Status: SUCCESS [ 733.721477] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.722260] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f95f28e-3c21-415e-9067-7aef8eff10d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.722260] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f95f28e-3c21-415e-9067-7aef8eff10d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.722260] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.722406] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.722406] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.722553] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.722640] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.722774] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f95f28e-3c21-415e-9067-7aef8eff10d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.722884] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8f95f28e-3c21-415e-9067-7aef8eff10d3',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.728042] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.728042] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.728042] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.728042] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.728042] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.728042] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.728042] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.728042] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.728042] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.728042] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f95f28e-3c21-415e-9067-7aef8eff10d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.728042] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f95f28e-3c21-415e-9067-7aef8eff10d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.728042] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.728042] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.728042] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.728042] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.728042] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.728625] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f95f28e-3c21-415e-9067-7aef8eff10d3',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.728858] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.729029] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.729208] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.729305] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.729364] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.729502] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.729573] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.729653] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.918340] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24a59c7c-3185-4ae4-af15-7deeba4a037c in Status: SUCCESS [ 733.918561] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24a59c7c-3185-4ae4-af15-7deeba4a037c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.918741] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24a59c7c-3185-4ae4-af15-7deeba4a037c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.918952] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24a59c7c-3185-4ae4-af15-7deeba4a037c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.919196] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.919321] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.921162] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.921162] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.921162] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.921162] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24a59c7c-3185-4ae4-af15-7deeba4a037c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.921162] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('24a59c7c-3185-4ae4-af15-7deeba4a037c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.234416] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('14cff10c-171f-4bbf-8531-6de5c6c7cc48',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.236025] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8f95f28e-3c21-415e-9067-7aef8eff10d3',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.236516] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-870ec36b-ba1d-4422-a26d-1328f51f79e4 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.236666] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.236855] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f95f28e-3c21-415e-9067-7aef8eff10d3',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.237885] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.426162] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('24a59c7c-3185-4ae4-af15-7deeba4a037c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.740702] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f95f28e-3c21-415e-9067-7aef8eff10d3',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.741751] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8f95f28e-3c21-415e-9067-7aef8eff10d3: rpc.has_security_group_logging(os_id): False [ 734.742988] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.743138] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.743206] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.743439] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.743492] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.743587] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14cff10c-171f-4bbf-8531-6de5c6c7cc48 is going to be created. [ 734.749631] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.765686] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.765876] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.765876] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.766166] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.766257] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.766492] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.766592] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.766636] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.768194] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.768194] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.768194] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f95f28e-3c21-415e-9067-7aef8eff10d3 is going to be created. [ 734.774199] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.774199] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.774199] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.774199] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.774199] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.792445] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14cff10c-171f-4bbf-8531-6de5c6c7cc48 in Status: UNINITIALIZED for 2s [ 734.840553] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.840738] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.840738] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.840878] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.841073] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.856484] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f95f28e-3c21-415e-9067-7aef8eff10d3 in Status: IN_PROGRESS for 2s [ 734.930566] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 24a59c7c-3185-4ae4-af15-7deeba4a037c: rpc.has_security_group_logging(os_id): False [ 734.954153] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.954310] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.954429] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.954585] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.954669] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.954936] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.955054] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.955096] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.955246] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.955315] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.955981] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24a59c7c-3185-4ae4-af15-7deeba4a037c is going to be created. [ 735.026635] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.026788] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.026857] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.027117] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.027333] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.041449] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24a59c7c-3185-4ae4-af15-7deeba4a037c in Status: IN_PROGRESS for 2s [ 735.125670] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c897dadb-95bc-4de7-a117-d38870fbace8 in Status: SUCCESS [ 735.125913] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c897dadb-95bc-4de7-a117-d38870fbace8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.126123] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c897dadb-95bc-4de7-a117-d38870fbace8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.126372] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c897dadb-95bc-4de7-a117-d38870fbace8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.126606] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.126730] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.126803] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.126988] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.127176] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.127283] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c897dadb-95bc-4de7-a117-d38870fbace8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.127381] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c897dadb-95bc-4de7-a117-d38870fbace8',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.246649] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.246649] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.246649] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.246786] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.246786] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.247264] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f95f28e-3c21-415e-9067-7aef8eff10d3 is going to be updated. [ 735.252354] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.252354] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.252657] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.252721] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.252821] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.252948] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 is going to be updated. [ 735.277465] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.277604] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.279230] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.279230] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.279230] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.280463] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.280612] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.280683] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.280836] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.280970] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.287469] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 in Status: IN_PROGRESS for 2s [ 735.289906] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f95f28e-3c21-415e-9067-7aef8eff10d3 in Status: IN_PROGRESS for 2s [ 735.630712] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c897dadb-95bc-4de7-a117-d38870fbace8',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.135114] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c897dadb-95bc-4de7-a117-d38870fbace8: rpc.has_security_group_logging(os_id): False [ 736.156926] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.157450] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.157722] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.160016] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.160016] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.160016] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.160016] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.160016] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.160016] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.160016] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.160016] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c897dadb-95bc-4de7-a117-d38870fbace8 is going to be created. [ 736.235541] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.235693] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.235767] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.236514] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.236746] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.254753] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c897dadb-95bc-4de7-a117-d38870fbace8 in Status: IN_PROGRESS for 2s [ 736.801084] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14cff10c-171f-4bbf-8531-6de5c6c7cc48 in Status: SUCCESS [ 736.801292] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14cff10c-171f-4bbf-8531-6de5c6c7cc48" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.801467] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14cff10c-171f-4bbf-8531-6de5c6c7cc48" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.801668] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14cff10c-171f-4bbf-8531-6de5c6c7cc48" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.802472] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.802472] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.802472] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.802472] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.802472] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.802472] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14cff10c-171f-4bbf-8531-6de5c6c7cc48" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.802472] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('14cff10c-171f-4bbf-8531-6de5c6c7cc48',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.867465] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f95f28e-3c21-415e-9067-7aef8eff10d3 in Status: SUCCESS [ 736.869132] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f95f28e-3c21-415e-9067-7aef8eff10d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.869132] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f95f28e-3c21-415e-9067-7aef8eff10d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.869415] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f95f28e-3c21-415e-9067-7aef8eff10d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.869415] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f95f28e-3c21-415e-9067-7aef8eff10d3',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.053843] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24a59c7c-3185-4ae4-af15-7deeba4a037c in Status: SUCCESS [ 737.054434] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24a59c7c-3185-4ae4-af15-7deeba4a037c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.299872] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 in Status: SUCCESS [ 737.299872] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.299872] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.299872] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.299872] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.299872] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.299872] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.299872] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.299872] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.299872] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.304377] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f95f28e-3c21-415e-9067-7aef8eff10d3 in Status: SUCCESS [ 737.304684] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f95f28e-3c21-415e-9067-7aef8eff10d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.304948] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('14cff10c-171f-4bbf-8531-6de5c6c7cc48',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.305767] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f95f28e-3c21-415e-9067-7aef8eff10d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.305958] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f95f28e-3c21-415e-9067-7aef8eff10d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.306149] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.306265] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.306334] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.306484] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.306565] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.306651] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f95f28e-3c21-415e-9067-7aef8eff10d3',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.375026] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f95f28e-3c21-415e-9067-7aef8eff10d3 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.375162] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f95f28e-3c21-415e-9067-7aef8eff10d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.810421] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 14cff10c-171f-4bbf-8531-6de5c6c7cc48: rpc.has_security_group_logging(os_id): False [ 737.810421] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f95f28e-3c21-415e-9067-7aef8eff10d3',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.810966] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.831202] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.835138] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.835138] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.835138] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.835138] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.835138] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.838164] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.838164] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.838164] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.838164] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.838164] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14cff10c-171f-4bbf-8531-6de5c6c7cc48 is going to be created. [ 737.891224] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.891675] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.891675] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.891775] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.891977] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.905815] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14cff10c-171f-4bbf-8531-6de5c6c7cc48 in Status: IN_PROGRESS for 2s [ 738.187110] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 738.187200] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=7 [ 738.207951] env[68328]: INFO networking_nsxv3.common.synchronization [req-f7993dab-1982-4bdc-bc6b-92176b30e7e2 req-a7f8dbfa-f952-4b6e-a0eb-39ab0fcc4bad tempest-ServerActionsTestJSON-719988657 tempest-ServerActionsTestJSON-719988657-project-member] Enqueued Resource ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 with Priority: HIGHEST for action security_group_members [ 738.210629] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 with Priority: HIGHEST for action security_group_members [ 738.210990] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.211136] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.211208] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.211468] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.211650] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.211751] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.211814] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.212085] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.212210] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.213200] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8024e0cc-9eaa-4282-b00c-9e9b1de030e2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.265389] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c897dadb-95bc-4de7-a117-d38870fbace8 in Status: SUCCESS [ 738.265732] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c897dadb-95bc-4de7-a117-d38870fbace8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.314121] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.315308] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f95f28e-3c21-415e-9067-7aef8eff10d3',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.703536] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-74 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.703695] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-74" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.703816] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-74" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.706835] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-74" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.707238] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.707437] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.707559] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.707790] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.707927] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.708152] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 738.708262] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 738.708368] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 738.708470] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 738.708572] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 738.708671] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 738.708800] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 738.716491] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.716616] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.716690] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.716874] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.717014] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.717243] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.717356] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.717423] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.717588] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.717667] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.717751] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 already deleted. [ 738.717829] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.730748] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 738.730932] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 738.731093] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 738.731277] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-74" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.731591] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-aff6b866-df4a-4b0b-b7cd-8ce29ffa14eb taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.731759] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-aff6b866-df4a-4b0b-b7cd-8ce29ffa14eb" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.731875] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-aff6b866-df4a-4b0b-b7cd-8ce29ffa14eb" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.732225] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-aff6b866-df4a-4b0b-b7cd-8ce29ffa14eb" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.732369] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aff6b866-df4a-4b0b-b7cd-8ce29ffa14eb',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.817028] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.817028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.817028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.817286] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.817316] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.817464] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 is going to be updated. [ 738.818924] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.818924] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.819096] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.819233] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.819276] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.819374] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f95f28e-3c21-415e-9067-7aef8eff10d3 is going to be updated. [ 738.849692] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.849692] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.849692] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.849692] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.849692] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.851757] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.852488] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.852488] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.852755] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.852896] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.863829] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f95f28e-3c21-415e-9067-7aef8eff10d3 in Status: IN_PROGRESS for 2s [ 738.865202] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 in Status: IN_PROGRESS for 2s [ 739.234971] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.236347] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.236347] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.236347] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.236347] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.236499] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port aff6b866-df4a-4b0b-b7cd-8ce29ffa14eb not found, creating... [ 739.236738] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.236923] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.237077] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.237455] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.237616] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.237937] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.238453] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.238542] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.238790] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.238932] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.239337] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: aff6b866-df4a-4b0b-b7cd-8ce29ffa14eb is going to be created. [ 739.243537] env[68328]: INFO networking_nsxv3.common.synchronization [None req-7f4289bd-a30e-421e-ac44-35d1d7803476 None None] Enqueued Resource ID: 995ba2a9-2863-40b1-a670-4353606c842b with Priority: HIGHEST for action port [ 739.243826] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 995ba2a9-2863-40b1-a670-4353606c842b with Priority: HIGHEST for action port [ 739.244371] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-995ba2a9-2863-40b1-a670-4353606c842b taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.244479] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-995ba2a9-2863-40b1-a670-4353606c842b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.244540] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-995ba2a9-2863-40b1-a670-4353606c842b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.244767] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-995ba2a9-2863-40b1-a670-4353606c842b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.244842] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('995ba2a9-2863-40b1-a670-4353606c842b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.266726] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.266982] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.267125] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.267520] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.267618] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.267848] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-aff6b866-df4a-4b0b-b7cd-8ce29ffa14eb" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.746651] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 995ba2a9-2863-40b1-a670-4353606c842b [ 739.747294] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.747294] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.747294] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.747725] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.747725] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.747725] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:995ba2a9-2863-40b1-a670-4353606c842b already deleted. [ 739.747725] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-995ba2a9-2863-40b1-a670-4353606c842b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.920369] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14cff10c-171f-4bbf-8531-6de5c6c7cc48 in Status: SUCCESS [ 739.923034] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14cff10c-171f-4bbf-8531-6de5c6c7cc48" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.190581] env[68328]: INFO networking_nsxv3.common.synchronization [req-f7993dab-1982-4bdc-bc6b-92176b30e7e2 req-af1bdb05-dfc2-4ed1-894b-b08eba068161 service nova] Enqueued Resource ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 with Priority: HIGHEST for action security_group_rules [ 740.190771] env[68328]: INFO networking_nsxv3.common.synchronization [req-f7993dab-1982-4bdc-bc6b-92176b30e7e2 req-af1bdb05-dfc2-4ed1-894b-b08eba068161 service nova] Enqueued Resource ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 with Priority: HIGHEST for action security_group_members [ 740.190925] env[68328]: INFO networking_nsxv3.common.synchronization [req-f7993dab-1982-4bdc-bc6b-92176b30e7e2 req-af1bdb05-dfc2-4ed1-894b-b08eba068161 service nova] Enqueued Resource ID: aff6b866-df4a-4b0b-b7cd-8ce29ffa14eb with Priority: HIGHEST for action port [ 740.191223] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 with Priority: HIGHEST for action security_group_rules [ 740.191354] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 with Priority: HIGHEST for action security_group_members [ 740.191460] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aff6b866-df4a-4b0b-b7cd-8ce29ffa14eb with Priority: HIGHEST for action port [ 740.195907] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8024e0cc-9eaa-4282-b00c-9e9b1de030e2 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.196073] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.196145] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.196371] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.196456] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8024e0cc-9eaa-4282-b00c-9e9b1de030e2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.197501] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.197596] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.198066] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.198066] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.198066] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.198200] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.198200] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.198301] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.198383] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.198470] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8024e0cc-9eaa-4282-b00c-9e9b1de030e2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.203085] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-aff6b866-df4a-4b0b-b7cd-8ce29ffa14eb taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.203221] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aff6b866-df4a-4b0b-b7cd-8ce29ffa14eb" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.204022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aff6b866-df4a-4b0b-b7cd-8ce29ffa14eb" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.204022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aff6b866-df4a-4b0b-b7cd-8ce29ffa14eb" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.204022] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aff6b866-df4a-4b0b-b7cd-8ce29ffa14eb',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.704683] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8024e0cc-9eaa-4282-b00c-9e9b1de030e2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.705668] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.705774] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.708135] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aff6b866-df4a-4b0b-b7cd-8ce29ffa14eb with status ACTIVE [ 740.708135] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.708316] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.708316] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.708843] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.708843] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.708843] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.708843] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.709011] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.709011] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.709411] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.709469] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.709564] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.709623] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.709819] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.711023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.711023] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aff6b866-df4a-4b0b-b7cd-8ce29ffa14eb is going to be updated. [ 740.730474] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.730657] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.730657] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.730818] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.730986] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.731187] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aff6b866-df4a-4b0b-b7cd-8ce29ffa14eb" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.875297] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 in Status: SUCCESS [ 740.875591] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.876169] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f95f28e-3c21-415e-9067-7aef8eff10d3 in Status: SUCCESS [ 740.876324] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f95f28e-3c21-415e-9067-7aef8eff10d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.876548] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.877309] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.877309] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.877309] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.877309] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.877309] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.877580] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.877580] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.877580] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-870ec36b-ba1d-4422-a26d-1328f51f79e4 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.877708] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.877708] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.877844] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.877969] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.878070] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.878130] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.878269] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.878499] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.878499] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.878499] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.880510] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f95f28e-3c21-415e-9067-7aef8eff10d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.880510] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f95f28e-3c21-415e-9067-7aef8eff10d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.880510] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.880510] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.880510] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.880510] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.880510] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.880721] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f95f28e-3c21-415e-9067-7aef8eff10d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.880750] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8f95f28e-3c21-415e-9067-7aef8eff10d3',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.209062] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8024e0cc-9eaa-4282-b00c-9e9b1de030e2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.382418] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 870ec36b-ba1d-4422-a26d-1328f51f79e4: rpc.has_security_group_logging(os_id): False [ 741.383600] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8f95f28e-3c21-415e-9067-7aef8eff10d3',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.403025] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.403025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.403025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.403025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.403025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.403025] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.403025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.403025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.403025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.403025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.403025] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.403025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.403025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.403025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.403025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.403570] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.403570] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.403570] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.403570] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.403570] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.403570] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 is going to be updated. [ 741.465233] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.465233] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.465233] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.465233] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.465233] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.475025] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 in Status: IN_PROGRESS for 2s [ 741.712958] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.713083] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.713158] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.713389] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.713473] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.713579] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 is going to be created. [ 741.737139] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.737139] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.737139] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.737139] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.737139] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.745188] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 in Status: UNINITIALIZED for 2s [ 741.887118] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8f95f28e-3c21-415e-9067-7aef8eff10d3: rpc.has_security_group_logging(os_id): False [ 741.904099] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.904267] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.904340] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.904558] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.904651] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.904883] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.904982] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.905058] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.905206] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.905298] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.905396] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f95f28e-3c21-415e-9067-7aef8eff10d3 is going to be updated. [ 741.957298] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.957298] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.957298] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.957298] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.957298] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.968443] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f95f28e-3c21-415e-9067-7aef8eff10d3 in Status: IN_PROGRESS for 2s [ 743.489712] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 in Status: SUCCESS [ 743.489712] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.489712] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.489712] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.489712] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.758484] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 in Status: SUCCESS [ 743.763732] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.763732] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.763732] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.763732] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.763732] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.763732] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.763732] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.763732] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.763732] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.763732] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8024e0cc-9eaa-4282-b00c-9e9b1de030e2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.980954] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f95f28e-3c21-415e-9067-7aef8eff10d3 in Status: SUCCESS [ 743.980954] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f95f28e-3c21-415e-9067-7aef8eff10d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.993865] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-870ec36b-ba1d-4422-a26d-1328f51f79e4 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.993865] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.993865] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.993865] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.993865] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.993865] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.993865] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.993865] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.993865] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.993865] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.993865] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.269860] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8024e0cc-9eaa-4282-b00c-9e9b1de030e2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.502268] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-870ec36b-ba1d-4422-a26d-1328f51f79e4 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.502268] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.502268] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.502268] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.502268] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.502268] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.502268] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.502268] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.502268] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.502268] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.502268] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-870ec36b-ba1d-4422-a26d-1328f51f79e4 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.502268] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.502268] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.502268] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.502268] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.502268] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.502934] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.502934] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.502934] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.502934] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.502934] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.776179] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8024e0cc-9eaa-4282-b00c-9e9b1de030e2: rpc.has_security_group_logging(os_id): False [ 744.794103] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.794103] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.794103] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.794103] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.794103] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.794103] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.794103] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.794103] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.794103] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.794103] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.794103] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 is going to be created. [ 744.844979] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.845217] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.845319] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.845585] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.845809] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.855358] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 in Status: IN_PROGRESS for 2s [ 745.070979] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 870ec36b-ba1d-4422-a26d-1328f51f79e4: rpc.has_security_group_logging(os_id): False [ 745.070979] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.070979] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.070979] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.070979] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.070979] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.070979] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.070979] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.070979] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.070979] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.070979] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.070979] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.070979] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.070979] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.070979] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.071746] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.071746] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.071746] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.071746] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.071746] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.071746] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.071746] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 is going to be updated. [ 745.087034] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.087034] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.087034] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.087034] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.087034] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.099968] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 in Status: IN_PROGRESS for 2s [ 745.192667] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 745.192740] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 746.866336] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 in Status: SUCCESS [ 746.866609] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.113657] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 in Status: SUCCESS [ 747.113657] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.164960] env[68328]: INFO networking_nsxv3.common.synchronization [req-ed2f2aa0-9b30-4ac0-b102-7fac54e534ec req-5a19b736-3ae9-48be-9f7c-b5dd75ae1257 tempest-DeleteServersAdminTestJSON-355449425 tempest-DeleteServersAdminTestJSON-355449425-project-member] Enqueued Resource ID: f302de28-ce4b-4460-9ba9-d832cf4c957e with Priority: HIGHEST for action security_group_members [ 747.165648] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f302de28-ce4b-4460-9ba9-d832cf4c957e with Priority: HIGHEST for action security_group_members [ 747.165794] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-f302de28-ce4b-4460-9ba9-d832cf4c957e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.165914] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.165981] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.166191] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.166340] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.166438] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.166498] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.166642] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.166725] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.166815] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f302de28-ce4b-4460-9ba9-d832cf4c957e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.438558] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-739 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.438800] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-739" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.438884] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-739" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.439203] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-739" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.439511] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.439690] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.439819] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.440041] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.440196] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.440389] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 747.440496] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 747.440603] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 747.440709] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 747.440822] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 747.440912] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 747.441052] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 747.458365] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 747.458531] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 747.458671] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 747.458836] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-739" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.459144] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-19accbe6-0714-4f89-88bc-a49f0cbcefe9 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.459351] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-19accbe6-0714-4f89-88bc-a49f0cbcefe9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.459447] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-19accbe6-0714-4f89-88bc-a49f0cbcefe9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.459754] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-19accbe6-0714-4f89-88bc-a49f0cbcefe9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.459906] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19accbe6-0714-4f89-88bc-a49f0cbcefe9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.669328] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.669525] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.669600] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.669824] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.669917] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.670135] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.670236] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.670310] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.670466] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.670542] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.670644] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f302de28-ce4b-4460-9ba9-d832cf4c957e is going to be updated. [ 747.699087] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.699246] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.699341] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.699558] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.699700] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.706951] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f302de28-ce4b-4460-9ba9-d832cf4c957e in Status: IN_PROGRESS for 2s [ 747.962759] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.963137] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.963137] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.963416] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.963554] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.963711] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 19accbe6-0714-4f89-88bc-a49f0cbcefe9 not found, creating... [ 747.963968] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.964166] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.964357] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.964871] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.965035] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.965303] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.965463] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.965586] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.965841] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.965936] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.966085] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 19accbe6-0714-4f89-88bc-a49f0cbcefe9 is going to be created. [ 747.984948] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.985427] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.985554] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.985818] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.986062] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.986321] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-19accbe6-0714-4f89-88bc-a49f0cbcefe9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.718207] env[68328]: INFO networking_nsxv3.common.synchronization [req-ed2f2aa0-9b30-4ac0-b102-7fac54e534ec req-17126e4f-fa13-48ec-8a24-d8eb814522b9 service nova] Enqueued Resource ID: f302de28-ce4b-4460-9ba9-d832cf4c957e with Priority: HIGHEST for action security_group_rules [ 748.718403] env[68328]: INFO networking_nsxv3.common.synchronization [req-ed2f2aa0-9b30-4ac0-b102-7fac54e534ec req-17126e4f-fa13-48ec-8a24-d8eb814522b9 service nova] Enqueued Resource ID: f302de28-ce4b-4460-9ba9-d832cf4c957e with Priority: HIGHEST for action security_group_members [ 748.718544] env[68328]: INFO networking_nsxv3.common.synchronization [req-ed2f2aa0-9b30-4ac0-b102-7fac54e534ec req-17126e4f-fa13-48ec-8a24-d8eb814522b9 service nova] Enqueued Resource ID: 19accbe6-0714-4f89-88bc-a49f0cbcefe9 with Priority: HIGHEST for action port [ 748.719048] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f302de28-ce4b-4460-9ba9-d832cf4c957e with Priority: HIGHEST for action security_group_rules [ 748.719622] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f302de28-ce4b-4460-9ba9-d832cf4c957e with Priority: HIGHEST for action security_group_members [ 748.719622] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19accbe6-0714-4f89-88bc-a49f0cbcefe9 with Priority: HIGHEST for action port [ 748.719622] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f302de28-ce4b-4460-9ba9-d832cf4c957e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.720037] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.720037] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.720037] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.720207] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f302de28-ce4b-4460-9ba9-d832cf4c957e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.722045] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-f302de28-ce4b-4460-9ba9-d832cf4c957e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.722045] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.722045] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-19accbe6-0714-4f89-88bc-a49f0cbcefe9 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.722045] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-19accbe6-0714-4f89-88bc-a49f0cbcefe9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.722045] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-19accbe6-0714-4f89-88bc-a49f0cbcefe9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.722045] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-19accbe6-0714-4f89-88bc-a49f0cbcefe9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.722476] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19accbe6-0714-4f89-88bc-a49f0cbcefe9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.222550] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-f302de28-ce4b-4460-9ba9-d832cf4c957e taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.222550] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.225959] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 19accbe6-0714-4f89-88bc-a49f0cbcefe9 with status ACTIVE [ 749.225959] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.225959] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.225959] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.225959] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.225959] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.225959] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.225959] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.225959] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.225959] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.225959] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.225959] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.225959] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.225959] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.225959] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.225959] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.225959] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 19accbe6-0714-4f89-88bc-a49f0cbcefe9 is going to be updated. [ 749.245800] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.245800] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.245800] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.247054] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.247217] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.247399] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-19accbe6-0714-4f89-88bc-a49f0cbcefe9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.718829] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f302de28-ce4b-4460-9ba9-d832cf4c957e in Status: SUCCESS [ 749.718829] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f302de28-ce4b-4460-9ba9-d832cf4c957e deletion is rescheduled due to dependency. [ 749.718829] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.718829] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.718829] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.718829] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.718829] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.718829] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.718829] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.718829] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.718829] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f302de28-ce4b-4460-9ba9-d832cf4c957e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.757388] env[68328]: INFO networking_nsxv3.common.synchronization [req-262f2065-2ba8-49ea-aa36-e0e4c08868fd req-5ced2ae5-e46f-450c-bca3-9bbf9e90e27d tempest-ServersTestJSON-1500344576 tempest-ServersTestJSON-1500344576-project-member] Enqueued Resource ID: e6de510a-9045-41b5-b9c0-0c2740830426 with Priority: HIGHEST for action security_group_members [ 749.758042] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6de510a-9045-41b5-b9c0-0c2740830426 with Priority: HIGHEST for action security_group_members [ 749.758286] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6de510a-9045-41b5-b9c0-0c2740830426 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.758406] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6de510a-9045-41b5-b9c0-0c2740830426" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.758495] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6de510a-9045-41b5-b9c0-0c2740830426" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.758725] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6de510a-9045-41b5-b9c0-0c2740830426" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.758878] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.763199] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.763353] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.763505] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.763598] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.763694] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6de510a-9045-41b5-b9c0-0c2740830426',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.024781] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-950 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.024990] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-950" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.025128] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-950" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.025440] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-950" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.025711] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.025869] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.025987] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.026212] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.026355] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.026562] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 750.026674] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 750.026782] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 750.026890] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 750.026998] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 750.027137] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 750.027332] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 750.045374] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 750.045574] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 750.045753] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 750.045950] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-950" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.046290] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-5006568d-519f-4cf8-959a-e08a360a09e6 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.046496] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-5006568d-519f-4cf8-959a-e08a360a09e6" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.046727] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-5006568d-519f-4cf8-959a-e08a360a09e6" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.047223] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-5006568d-519f-4cf8-959a-e08a360a09e6" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.047223] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5006568d-519f-4cf8-959a-e08a360a09e6',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.226447] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f302de28-ce4b-4460-9ba9-d832cf4c957e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.265598] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.265751] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.265824] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.266056] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.266155] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.266351] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.266452] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.266513] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.266663] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.266736] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.266818] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6de510a-9045-41b5-b9c0-0c2740830426 already deleted. [ 750.266909] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6de510a-9045-41b5-b9c0-0c2740830426" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.549669] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.550274] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.550274] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.550626] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.550866] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.551129] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 5006568d-519f-4cf8-959a-e08a360a09e6 not found, creating... [ 750.551483] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.551815] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.552092] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.552407] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.552514] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.552872] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.553119] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.553279] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.553658] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.553820] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.554100] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 5006568d-519f-4cf8-959a-e08a360a09e6 is going to be created. [ 750.628355] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.628640] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.628825] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.629165] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.629491] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.629786] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-5006568d-519f-4cf8-959a-e08a360a09e6" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.728847] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f302de28-ce4b-4460-9ba9-d832cf4c957e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.232021] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.232309] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.232384] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.232700] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.232842] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.232991] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f302de28-ce4b-4460-9ba9-d832cf4c957e is going to be updated. [ 751.265199] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.265355] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.265401] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.265616] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.265759] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.274708] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f302de28-ce4b-4460-9ba9-d832cf4c957e in Status: IN_PROGRESS for 2s [ 751.327349] env[68328]: INFO networking_nsxv3.common.synchronization [req-262f2065-2ba8-49ea-aa36-e0e4c08868fd req-2b0f63a3-0c55-4aa5-9503-d55a00db701d service nova] Enqueued Resource ID: e6de510a-9045-41b5-b9c0-0c2740830426 with Priority: HIGHEST for action security_group_rules [ 751.327349] env[68328]: INFO networking_nsxv3.common.synchronization [req-262f2065-2ba8-49ea-aa36-e0e4c08868fd req-2b0f63a3-0c55-4aa5-9503-d55a00db701d service nova] Enqueued Resource ID: e6de510a-9045-41b5-b9c0-0c2740830426 with Priority: HIGHEST for action security_group_members [ 751.327349] env[68328]: INFO networking_nsxv3.common.synchronization [req-262f2065-2ba8-49ea-aa36-e0e4c08868fd req-2b0f63a3-0c55-4aa5-9503-d55a00db701d service nova] Enqueued Resource ID: 5006568d-519f-4cf8-959a-e08a360a09e6 with Priority: HIGHEST for action port [ 751.327349] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6de510a-9045-41b5-b9c0-0c2740830426 with Priority: HIGHEST for action security_group_rules [ 751.327349] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6de510a-9045-41b5-b9c0-0c2740830426 with Priority: HIGHEST for action security_group_members [ 751.327349] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5006568d-519f-4cf8-959a-e08a360a09e6 with Priority: HIGHEST for action port [ 751.327349] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6de510a-9045-41b5-b9c0-0c2740830426 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.327349] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6de510a-9045-41b5-b9c0-0c2740830426" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.327349] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6de510a-9045-41b5-b9c0-0c2740830426" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.327349] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6de510a-9045-41b5-b9c0-0c2740830426" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.327907] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6de510a-9045-41b5-b9c0-0c2740830426',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.329455] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6de510a-9045-41b5-b9c0-0c2740830426 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.329755] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6de510a-9045-41b5-b9c0-0c2740830426" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.329959] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6de510a-9045-41b5-b9c0-0c2740830426" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.330356] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6de510a-9045-41b5-b9c0-0c2740830426" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.330626] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.330887] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.331031] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.332447] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.332447] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.332447] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6de510a-9045-41b5-b9c0-0c2740830426',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.332983] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-5006568d-519f-4cf8-959a-e08a360a09e6 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.333218] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5006568d-519f-4cf8-959a-e08a360a09e6" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.333356] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5006568d-519f-4cf8-959a-e08a360a09e6" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.333592] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5006568d-519f-4cf8-959a-e08a360a09e6" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.333774] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5006568d-519f-4cf8-959a-e08a360a09e6',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.833321] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e6de510a-9045-41b5-b9c0-0c2740830426',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.836093] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5006568d-519f-4cf8-959a-e08a360a09e6 with status ACTIVE [ 751.836093] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.836093] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.836093] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.836093] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.836093] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.836604] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.836604] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.836604] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.836604] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.836604] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.836774] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.836822] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.836885] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.837079] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.837206] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.837472] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5006568d-519f-4cf8-959a-e08a360a09e6 is going to be updated. [ 751.841959] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6de510a-9045-41b5-b9c0-0c2740830426 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.841959] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6de510a-9045-41b5-b9c0-0c2740830426" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.860654] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.860787] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.860838] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.861313] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.861313] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.861426] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5006568d-519f-4cf8-959a-e08a360a09e6" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.344020] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e6de510a-9045-41b5-b9c0-0c2740830426',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.363415] env[68328]: INFO networking_nsxv3.common.synchronization [req-659ef053-e16f-4bed-ad83-8c5893283765 req-ffa980a0-1520-41db-9267-a64b8dc5b1fb tempest-AttachInterfacesUnderV243Test-835992920 tempest-AttachInterfacesUnderV243Test-835992920-project-member] Enqueued Resource ID: 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 with Priority: HIGHEST for action security_group_members [ 752.364842] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 with Priority: HIGHEST for action security_group_members [ 752.364842] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.364842] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.364842] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.365071] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.365230] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.365324] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.365385] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.365535] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.365644] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.365699] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2158d2f5-a6e7-415a-a8b1-6f8353f45cb8',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.834365] env[68328]: INFO networking_nsxv3.common.synchronization [req-2de41faf-2d10-4d6b-987c-040e894ac70b req-de38d7e9-9666-4dae-ac89-cba8a1d66f68 tempest-ImagesOneServerTestJSON-1899488142 tempest-ImagesOneServerTestJSON-1899488142-project-member] Enqueued Resource ID: 7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63 with Priority: HIGHEST for action security_group_members [ 752.834957] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63 with Priority: HIGHEST for action security_group_members [ 752.835204] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.835326] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.835396] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.835593] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.835746] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.835841] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.835901] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.836165] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.836270] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.836363] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.844362] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.844362] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.844596] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.844843] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.844843] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.844916] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6de510a-9045-41b5-b9c0-0c2740830426 is going to be created. [ 752.851493] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-8 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.851683] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.851852] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.852157] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.852390] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.852543] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.852654] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.852862] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.853066] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.853281] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 752.853996] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 752.853996] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 752.853996] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 752.853996] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 752.853996] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 752.853996] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 752.868960] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.869228] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.869266] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.869778] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.869778] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.869778] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.870104] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.870104] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.871107] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.871107] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.871107] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 already deleted. [ 752.871107] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.877352] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 752.877352] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 752.877352] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 752.877352] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.877352] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-77fb8c9e-5fb1-4376-bf0f-26b2223c6499 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.877352] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-77fb8c9e-5fb1-4376-bf0f-26b2223c6499" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.877352] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-77fb8c9e-5fb1-4376-bf0f-26b2223c6499" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.877352] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-77fb8c9e-5fb1-4376-bf0f-26b2223c6499" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.877352] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77fb8c9e-5fb1-4376-bf0f-26b2223c6499',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.877352] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.877352] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.877352] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.877352] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.877352] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.885244] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6de510a-9045-41b5-b9c0-0c2740830426 in Status: UNINITIALIZED for 2s [ 753.285062] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f302de28-ce4b-4460-9ba9-d832cf4c957e in Status: SUCCESS [ 753.285062] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.285062] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.285062] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.285317] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.285407] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.285511] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.285716] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.285809] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.285901] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.285991] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f302de28-ce4b-4460-9ba9-d832cf4c957e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.338177] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.338356] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.338465] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.338702] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.338834] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.338990] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.339093] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.339157] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.339340] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.339441] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.339522] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63 is going to be updated. [ 753.368419] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.368697] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.368697] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.368922] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.369141] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.379745] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63 in Status: IN_PROGRESS for 2s [ 753.380193] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.380398] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.380535] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.380800] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.380970] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.381185] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 77fb8c9e-5fb1-4376-bf0f-26b2223c6499 not found, creating... [ 753.381449] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.381919] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.381919] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.381919] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.382084] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.382378] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.382595] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.382796] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.383133] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.383341] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.383553] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 77fb8c9e-5fb1-4376-bf0f-26b2223c6499 is going to be created. [ 753.403565] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.403759] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.403870] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.404138] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.404357] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.404605] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-77fb8c9e-5fb1-4376-bf0f-26b2223c6499" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.789031] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-f302de28-ce4b-4460-9ba9-d832cf4c957e taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.789197] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.789381] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.789707] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.789989] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.790204] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.790339] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.790659] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.790842] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.791016] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.791927] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-f302de28-ce4b-4460-9ba9-d832cf4c957e taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.791927] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.791927] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.791927] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.792118] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.792163] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.792263] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.792508] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.792675] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.792841] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.792976] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f302de28-ce4b-4460-9ba9-d832cf4c957e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.284108] env[68328]: INFO networking_nsxv3.common.synchronization [req-659ef053-e16f-4bed-ad83-8c5893283765 req-2ce518eb-a2c8-42bc-bfa9-dd5413e9f63d service nova] Enqueued Resource ID: 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 with Priority: HIGHEST for action security_group_rules [ 754.284108] env[68328]: INFO networking_nsxv3.common.synchronization [req-659ef053-e16f-4bed-ad83-8c5893283765 req-2ce518eb-a2c8-42bc-bfa9-dd5413e9f63d service nova] Enqueued Resource ID: 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 with Priority: HIGHEST for action security_group_members [ 754.284108] env[68328]: INFO networking_nsxv3.common.synchronization [req-659ef053-e16f-4bed-ad83-8c5893283765 req-2ce518eb-a2c8-42bc-bfa9-dd5413e9f63d service nova] Enqueued Resource ID: 77fb8c9e-5fb1-4376-bf0f-26b2223c6499 with Priority: HIGHEST for action port [ 754.284108] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 with Priority: HIGHEST for action security_group_rules [ 754.284108] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 with Priority: HIGHEST for action security_group_members [ 754.284108] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77fb8c9e-5fb1-4376-bf0f-26b2223c6499 with Priority: HIGHEST for action port [ 754.284108] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.284108] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.284108] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.284108] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.284108] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2158d2f5-a6e7-415a-a8b1-6f8353f45cb8',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.285365] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.285623] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.285794] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.286065] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.289066] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.289066] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.289066] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.289066] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.289066] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.289066] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2158d2f5-a6e7-415a-a8b1-6f8353f45cb8',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.289066] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-77fb8c9e-5fb1-4376-bf0f-26b2223c6499 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.289066] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77fb8c9e-5fb1-4376-bf0f-26b2223c6499" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.289066] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77fb8c9e-5fb1-4376-bf0f-26b2223c6499" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.289066] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77fb8c9e-5fb1-4376-bf0f-26b2223c6499" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.289066] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77fb8c9e-5fb1-4376-bf0f-26b2223c6499',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.295937] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f302de28-ce4b-4460-9ba9-d832cf4c957e: rpc.has_security_group_logging(os_id): False [ 754.325567] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.325567] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.325567] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.325567] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.325567] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.325567] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.325567] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.325567] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.325567] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.325567] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.325567] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.325567] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.325567] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.325567] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.325567] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.326114] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.326114] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.326114] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.326114] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.326114] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.326114] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f302de28-ce4b-4460-9ba9-d832cf4c957e is going to be updated. [ 754.417527] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.417832] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.417886] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.418166] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.418376] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.434072] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f302de28-ce4b-4460-9ba9-d832cf4c957e in Status: IN_PROGRESS for 2s [ 754.789562] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2158d2f5-a6e7-415a-a8b1-6f8353f45cb8',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.790758] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.790856] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.791306] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 77fb8c9e-5fb1-4376-bf0f-26b2223c6499 with status ACTIVE [ 754.791549] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.791881] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.791881] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.792119] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.792271] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.792582] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.792690] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.792791] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.793060] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.793177] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.793423] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.793640] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.793640] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.793726] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.793794] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.794031] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 77fb8c9e-5fb1-4376-bf0f-26b2223c6499 is going to be updated. [ 754.815814] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.815985] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.816049] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.816247] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.816379] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.816537] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77fb8c9e-5fb1-4376-bf0f-26b2223c6499" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.894541] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6de510a-9045-41b5-b9c0-0c2740830426 in Status: SUCCESS [ 754.894751] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6de510a-9045-41b5-b9c0-0c2740830426" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.894945] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6de510a-9045-41b5-b9c0-0c2740830426" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.895173] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6de510a-9045-41b5-b9c0-0c2740830426" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.895365] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.895480] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.895569] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.895947] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.896057] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.896149] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6de510a-9045-41b5-b9c0-0c2740830426" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.896243] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e6de510a-9045-41b5-b9c0-0c2740830426',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.026297] env[68328]: INFO networking_nsxv3.common.synchronization [req-81f1878c-2215-409f-9dcc-d039e729991a req-29865cc8-1445-40a7-924a-2a3015cde768 tempest-ListImageFiltersTestJSON-876538757 tempest-ListImageFiltersTestJSON-876538757-project-member] Enqueued Resource ID: d160efa7-0312-433f-b94f-cf7e99e24473 with Priority: HIGHEST for action security_group_members [ 755.026749] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d160efa7-0312-433f-b94f-cf7e99e24473 with Priority: HIGHEST for action security_group_members [ 755.027059] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-d160efa7-0312-433f-b94f-cf7e99e24473 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.027183] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.027268] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.027515] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.027670] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.027765] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.027827] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.027968] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.028623] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.028623] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d160efa7-0312-433f-b94f-cf7e99e24473',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.291919] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2158d2f5-a6e7-415a-a8b1-6f8353f45cb8',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.294409] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-739 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.294595] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-739" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.294717] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-739" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.294974] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-739" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.295242] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.295397] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.295516] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.295724] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.295864] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.296079] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 755.296191] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 755.296297] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 755.296403] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 755.296516] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 755.296615] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 755.296746] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 755.315880] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 755.316475] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 755.316475] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 755.316599] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-739" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.317374] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-c866d313-b06a-4c7c-aea4-d37c41e2cb74 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.317374] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-c866d313-b06a-4c7c-aea4-d37c41e2cb74" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.317374] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-c866d313-b06a-4c7c-aea4-d37c41e2cb74" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.317621] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-c866d313-b06a-4c7c-aea4-d37c41e2cb74" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.318674] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c866d313-b06a-4c7c-aea4-d37c41e2cb74',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.389345] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63 in Status: SUCCESS [ 755.389345] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63 deletion is rescheduled due to dependency. [ 755.389345] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.399639] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e6de510a-9045-41b5-b9c0-0c2740830426',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.531423] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.531740] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.531740] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.532335] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.532335] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.532335] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.532335] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.533042] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.533042] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.533042] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.533042] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d160efa7-0312-433f-b94f-cf7e99e24473 already deleted. [ 755.533042] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.798868] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.799096] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.799264] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.799550] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.799692] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.799819] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 is going to be created. [ 755.820590] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.820737] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.820856] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.821150] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.821297] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.821447] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port c866d313-b06a-4c7c-aea4-d37c41e2cb74 not found, creating... [ 755.821854] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.822047] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.822179] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.822410] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.822545] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.822829] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.822973] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.823100] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.823299] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.823464] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.823616] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: c866d313-b06a-4c7c-aea4-d37c41e2cb74 is going to be created. [ 755.826032] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.826032] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.826032] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.826032] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.826032] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.835927] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 in Status: UNINITIALIZED for 2s [ 755.844428] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.844616] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.844746] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.844996] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.845262] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.845476] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-c866d313-b06a-4c7c-aea4-d37c41e2cb74" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.905173] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e6de510a-9045-41b5-b9c0-0c2740830426: rpc.has_security_group_logging(os_id): False [ 755.927087] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.927232] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.927306] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.927528] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.927621] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.927886] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.927987] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.928053] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.928221] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.928295] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.928396] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6de510a-9045-41b5-b9c0-0c2740830426 is going to be created. [ 756.015058] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.015291] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.015291] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.015378] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.015614] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.030090] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6de510a-9045-41b5-b9c0-0c2740830426 in Status: IN_PROGRESS for 2s [ 756.448156] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f302de28-ce4b-4460-9ba9-d832cf4c957e in Status: SUCCESS [ 756.448431] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.549404] env[68328]: INFO networking_nsxv3.common.synchronization [req-81f1878c-2215-409f-9dcc-d039e729991a req-9b1d6304-1eb4-4e7b-a366-3b6a20cc3540 service nova] Enqueued Resource ID: d160efa7-0312-433f-b94f-cf7e99e24473 with Priority: HIGHEST for action security_group_rules [ 756.549786] env[68328]: INFO networking_nsxv3.common.synchronization [req-81f1878c-2215-409f-9dcc-d039e729991a req-9b1d6304-1eb4-4e7b-a366-3b6a20cc3540 service nova] Enqueued Resource ID: d160efa7-0312-433f-b94f-cf7e99e24473 with Priority: HIGHEST for action security_group_members [ 756.549786] env[68328]: INFO networking_nsxv3.common.synchronization [req-81f1878c-2215-409f-9dcc-d039e729991a req-9b1d6304-1eb4-4e7b-a366-3b6a20cc3540 service nova] Enqueued Resource ID: c866d313-b06a-4c7c-aea4-d37c41e2cb74 with Priority: HIGHEST for action port [ 756.550024] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d160efa7-0312-433f-b94f-cf7e99e24473 with Priority: HIGHEST for action security_group_rules [ 756.550167] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d160efa7-0312-433f-b94f-cf7e99e24473 with Priority: HIGHEST for action security_group_members [ 756.550342] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c866d313-b06a-4c7c-aea4-d37c41e2cb74 with Priority: HIGHEST for action port [ 756.550835] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d160efa7-0312-433f-b94f-cf7e99e24473 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.550960] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.551646] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.551862] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.551955] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d160efa7-0312-433f-b94f-cf7e99e24473',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.553589] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-d160efa7-0312-433f-b94f-cf7e99e24473 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.553721] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.553849] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.555035] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.555850] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.555972] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.556072] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.556233] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.556990] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.557106] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d160efa7-0312-433f-b94f-cf7e99e24473',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.559378] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-c866d313-b06a-4c7c-aea4-d37c41e2cb74 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.559498] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c866d313-b06a-4c7c-aea4-d37c41e2cb74" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.560116] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c866d313-b06a-4c7c-aea4-d37c41e2cb74" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.560387] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c866d313-b06a-4c7c-aea4-d37c41e2cb74" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.560464] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c866d313-b06a-4c7c-aea4-d37c41e2cb74',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.054348] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-d160efa7-0312-433f-b94f-cf7e99e24473 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.054348] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.060068] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d160efa7-0312-433f-b94f-cf7e99e24473',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.068977] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c866d313-b06a-4c7c-aea4-d37c41e2cb74 with status ACTIVE [ 757.069207] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.069332] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.069499] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.069659] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.069764] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.069975] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.070099] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.070176] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.070362] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.070459] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.070670] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.070792] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.070848] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.071021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.071236] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.071294] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c866d313-b06a-4c7c-aea4-d37c41e2cb74 is going to be updated. [ 757.089977] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.090169] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.090213] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.090385] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.090512] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.090676] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c866d313-b06a-4c7c-aea4-d37c41e2cb74" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.561690] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d160efa7-0312-433f-b94f-cf7e99e24473',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.598061] env[68328]: INFO networking_nsxv3.common.synchronization [req-930b1e2c-c64d-490b-b9a1-886f0f6d409d req-bb3105ef-133c-45bb-a19a-671f82739f4d tempest-ImagesTestJSON-69996350 tempest-ImagesTestJSON-69996350-project-member] Enqueued Resource ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 with Priority: HIGHEST for action security_group_members [ 757.598672] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 with Priority: HIGHEST for action security_group_members [ 757.598848] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-249b36cf-74ee-44d9-b2c9-d728a30d9a09 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.598967] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.599697] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.600017] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.600220] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.600358] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.600452] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.600744] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.600744] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.600849] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('249b36cf-74ee-44d9-b2c9-d728a30d9a09',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.845024] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 in Status: SUCCESS [ 757.845251] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.846071] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.846071] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.846071] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.846071] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.846071] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.846294] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.846294] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.846350] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.846395] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2158d2f5-a6e7-415a-a8b1-6f8353f45cb8',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.915021] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-834 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.915021] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-834" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.915021] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-834" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.915021] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-834" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.915021] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.915453] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.915749] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.916095] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.916343] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.916639] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 757.918420] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 757.918420] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 757.918420] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 757.918420] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 757.918420] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 757.918420] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 757.935941] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 757.936136] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 757.936275] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 757.936449] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-834" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.936811] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-6400cd78-3139-4543-bb08-e8cd234f9699 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.936934] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-6400cd78-3139-4543-bb08-e8cd234f9699" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.937037] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-6400cd78-3139-4543-bb08-e8cd234f9699" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.937412] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-6400cd78-3139-4543-bb08-e8cd234f9699" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.937635] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6400cd78-3139-4543-bb08-e8cd234f9699',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.042544] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6de510a-9045-41b5-b9c0-0c2740830426 in Status: SUCCESS [ 758.042777] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6de510a-9045-41b5-b9c0-0c2740830426" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.063901] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.063985] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.064037] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.064249] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.064307] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.064410] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d160efa7-0312-433f-b94f-cf7e99e24473 is going to be created. [ 758.084993] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.085233] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.085233] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.085606] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.085796] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.093799] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d160efa7-0312-433f-b94f-cf7e99e24473 in Status: UNINITIALIZED for 2s [ 758.103389] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.103588] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.103730] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.104050] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.104189] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.104474] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.104629] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.104726] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.104952] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.105088] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.105216] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 already deleted. [ 758.105339] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.349051] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2158d2f5-a6e7-415a-a8b1-6f8353f45cb8',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.443188] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.443188] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.443188] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.443468] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.443468] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.443584] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 6400cd78-3139-4543-bb08-e8cd234f9699 not found, creating... [ 758.443871] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.444048] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.444172] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.444472] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.444538] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.444930] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.445116] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.445236] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.445464] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.445603] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.445802] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 6400cd78-3139-4543-bb08-e8cd234f9699 is going to be created. [ 758.465235] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.465453] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.465699] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.466031] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.466262] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.466538] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-6400cd78-3139-4543-bb08-e8cd234f9699" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.851381] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8: rpc.has_security_group_logging(os_id): False [ 758.868965] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.869229] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.869229] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.869599] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.869599] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.869828] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.869916] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.870048] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.870130] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.870205] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.870289] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 is going to be created. [ 758.925225] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.925394] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.925434] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.925668] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.925901] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.944366] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 in Status: IN_PROGRESS for 2s [ 759.243112] env[68328]: INFO networking_nsxv3.common.synchronization [req-930b1e2c-c64d-490b-b9a1-886f0f6d409d req-1aeff9ab-3d9e-43f6-94da-327a05e74cc8 service nova] Enqueued Resource ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 with Priority: HIGHEST for action security_group_rules [ 759.243112] env[68328]: INFO networking_nsxv3.common.synchronization [req-930b1e2c-c64d-490b-b9a1-886f0f6d409d req-1aeff9ab-3d9e-43f6-94da-327a05e74cc8 service nova] Enqueued Resource ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 with Priority: HIGHEST for action security_group_members [ 759.243112] env[68328]: INFO networking_nsxv3.common.synchronization [req-930b1e2c-c64d-490b-b9a1-886f0f6d409d req-1aeff9ab-3d9e-43f6-94da-327a05e74cc8 service nova] Enqueued Resource ID: 6400cd78-3139-4543-bb08-e8cd234f9699 with Priority: HIGHEST for action port [ 759.243112] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 with Priority: HIGHEST for action security_group_rules [ 759.243112] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 with Priority: HIGHEST for action security_group_members [ 759.243112] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6400cd78-3139-4543-bb08-e8cd234f9699 with Priority: HIGHEST for action port [ 759.243788] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-249b36cf-74ee-44d9-b2c9-d728a30d9a09 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.243973] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.244080] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.244366] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.244471] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('249b36cf-74ee-44d9-b2c9-d728a30d9a09',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.246288] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-249b36cf-74ee-44d9-b2c9-d728a30d9a09 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.246723] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.246850] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.247326] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.247326] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.247326] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.247461] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.248143] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.248143] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.248143] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('249b36cf-74ee-44d9-b2c9-d728a30d9a09',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.248973] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-6400cd78-3139-4543-bb08-e8cd234f9699 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.249146] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6400cd78-3139-4543-bb08-e8cd234f9699" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.249585] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6400cd78-3139-4543-bb08-e8cd234f9699" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.249739] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6400cd78-3139-4543-bb08-e8cd234f9699" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.249832] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6400cd78-3139-4543-bb08-e8cd234f9699',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.746950] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-249b36cf-74ee-44d9-b2c9-d728a30d9a09 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.747157] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.751610] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6400cd78-3139-4543-bb08-e8cd234f9699 with status ACTIVE [ 759.751895] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.752102] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.752230] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.752490] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.752609] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.752826] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.752966] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.753060] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.753268] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.753374] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.753595] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.753689] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.753758] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.753892] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.754012] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.754109] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6400cd78-3139-4543-bb08-e8cd234f9699 is going to be updated. [ 759.755306] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('249b36cf-74ee-44d9-b2c9-d728a30d9a09',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.774481] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.774695] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.774695] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.774892] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.775041] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.775229] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6400cd78-3139-4543-bb08-e8cd234f9699" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.104970] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d160efa7-0312-433f-b94f-cf7e99e24473 in Status: SUCCESS [ 760.104970] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.105287] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.105344] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.105781] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.105781] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.105781] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.105978] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.105978] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.106116] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.106244] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d160efa7-0312-433f-b94f-cf7e99e24473',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.258045] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('249b36cf-74ee-44d9-b2c9-d728a30d9a09',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.544482] env[68328]: INFO networking_nsxv3.common.synchronization [req-f0ea39c6-087f-4dc5-ac53-e354193017ba req-7546c1f2-806e-442c-bfd8-5306e14fbb2c tempest-DeleteServersAdminTestJSON-355449425 tempest-DeleteServersAdminTestJSON-355449425-project-member] Enqueued Resource ID: f302de28-ce4b-4460-9ba9-d832cf4c957e with Priority: HIGHEST for action security_group_members [ 760.544482] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f302de28-ce4b-4460-9ba9-d832cf4c957e with Priority: HIGHEST for action security_group_members [ 760.544759] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-f302de28-ce4b-4460-9ba9-d832cf4c957e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.545081] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.545305] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.545680] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.546028] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.546302] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.546504] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.546846] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.547112] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.547370] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f302de28-ce4b-4460-9ba9-d832cf4c957e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.609041] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-d160efa7-0312-433f-b94f-cf7e99e24473 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.609204] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.609204] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.609528] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.609699] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.609826] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.609890] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.610010] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.610112] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.610213] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.610406] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-d160efa7-0312-433f-b94f-cf7e99e24473 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.610502] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.610502] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.610656] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.610788] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.610875] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.610931] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.611110] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.611179] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.611233] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.611340] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d160efa7-0312-433f-b94f-cf7e99e24473',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.763616] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.763616] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.763616] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.763616] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.763616] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.763616] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 is going to be created. [ 760.787071] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.787071] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.787071] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.787071] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.787071] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.797234] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 in Status: UNINITIALIZED for 2s [ 760.957963] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 in Status: SUCCESS [ 760.958931] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.050044] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.050219] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.050304] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.050535] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.050648] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.050839] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.050937] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.050999] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.051164] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.051242] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.051328] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f302de28-ce4b-4460-9ba9-d832cf4c957e is going to be updated. [ 761.081162] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.081162] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.081162] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.081162] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.081162] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.088611] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f302de28-ce4b-4460-9ba9-d832cf4c957e in Status: IN_PROGRESS for 2s [ 761.114939] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d160efa7-0312-433f-b94f-cf7e99e24473: rpc.has_security_group_logging(os_id): False [ 761.133745] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.133887] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.133964] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.134184] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.134278] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.134467] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.134569] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.134632] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.134781] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.134857] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.135063] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.135163] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.135225] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.135363] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.135436] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.135629] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.135721] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.135778] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.135918] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.135992] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.136087] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d160efa7-0312-433f-b94f-cf7e99e24473 is going to be created. [ 761.219130] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.219130] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.219130] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.219427] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.219427] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.235509] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d160efa7-0312-433f-b94f-cf7e99e24473 in Status: IN_PROGRESS for 2s [ 762.193796] env[68328]: INFO networking_nsxv3.common.synchronization [req-7c54067a-b828-4426-8593-a279b32846bf req-dd4f374a-a2b9-470a-b1d4-cd920005f522 tempest-ServersAdminNegativeTestJSON-100889397 tempest-ServersAdminNegativeTestJSON-100889397-project-member] Enqueued Resource ID: 55dff300-131a-42f9-920d-f2b5a3b91449 with Priority: HIGHEST for action security_group_members [ 762.194311] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55dff300-131a-42f9-920d-f2b5a3b91449 with Priority: HIGHEST for action security_group_members [ 762.194603] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-55dff300-131a-42f9-920d-f2b5a3b91449 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.194725] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.194830] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.194990] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.195629] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.195738] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.195805] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.195983] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.196058] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.196153] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55dff300-131a-42f9-920d-f2b5a3b91449',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.469250] env[68328]: INFO networking_nsxv3.common.synchronization [req-10ed5dea-922a-40ec-9ac9-804fd95d136a req-c16076aa-c65b-4202-bc91-ef14e457efe3 tempest-ListImageFiltersTestJSON-876538757 tempest-ListImageFiltersTestJSON-876538757-project-member] Enqueued Resource ID: d160efa7-0312-433f-b94f-cf7e99e24473 with Priority: HIGHEST for action security_group_members [ 762.469893] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d160efa7-0312-433f-b94f-cf7e99e24473 with Priority: HIGHEST for action security_group_members [ 762.470218] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-d160efa7-0312-433f-b94f-cf7e99e24473 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.470343] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.470413] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.470611] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.470764] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.470860] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.470918] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.471104] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.471192] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.471355] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d160efa7-0312-433f-b94f-cf7e99e24473',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.699721] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.699721] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.699721] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.699721] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.699721] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.699721] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.699721] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.699721] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.699721] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.700106] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.700106] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55dff300-131a-42f9-920d-f2b5a3b91449 is going to be updated. [ 762.726366] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.726534] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.726575] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.726769] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.726902] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.735055] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55dff300-131a-42f9-920d-f2b5a3b91449 in Status: IN_PROGRESS for 2s [ 762.809760] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 in Status: SUCCESS [ 762.810016] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.810208] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.810427] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.810621] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.810737] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.810800] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.810961] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.811066] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.811154] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.811243] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('249b36cf-74ee-44d9-b2c9-d728a30d9a09',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.909639] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-739 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.909639] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-739" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.909639] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-739" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.909639] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-739" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.909639] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.909639] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.909639] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.909639] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.909639] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.910190] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 762.910190] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 762.910190] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 762.910190] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 762.910306] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 762.911026] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 762.911026] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 762.928189] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 762.928344] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 762.928476] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 762.928634] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-739" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.928921] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-3eed3435-95b4-41f7-ab7e-2373ce84e38f taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.929091] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-3eed3435-95b4-41f7-ab7e-2373ce84e38f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.929208] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-3eed3435-95b4-41f7-ab7e-2373ce84e38f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.929540] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-3eed3435-95b4-41f7-ab7e-2373ce84e38f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.929677] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3eed3435-95b4-41f7-ab7e-2373ce84e38f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.974125] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d160efa7-0312-433f-b94f-cf7e99e24473',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.098469] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f302de28-ce4b-4460-9ba9-d832cf4c957e in Status: SUCCESS [ 763.098739] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f302de28-ce4b-4460-9ba9-d832cf4c957e deletion is rescheduled due to dependency. [ 763.098876] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.246849] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d160efa7-0312-433f-b94f-cf7e99e24473 in Status: SUCCESS [ 763.247178] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.318785] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-249b36cf-74ee-44d9-b2c9-d728a30d9a09 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.318998] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.319068] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.320402] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.320602] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.320718] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.320782] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.320949] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.321101] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.321171] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.321661] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-249b36cf-74ee-44d9-b2c9-d728a30d9a09 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.321661] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.321661] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.321661] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.321931] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.321931] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.321931] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.322133] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.322133] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.322237] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.322325] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('249b36cf-74ee-44d9-b2c9-d728a30d9a09',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.432409] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.432638] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.432763] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.433059] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.433251] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.433415] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 3eed3435-95b4-41f7-ab7e-2373ce84e38f not found, creating... [ 763.433684] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.433836] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.433960] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.434198] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.434390] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.434840] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.435056] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.435261] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.435511] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.439018] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.439018] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 3eed3435-95b4-41f7-ab7e-2373ce84e38f is going to be created. [ 763.457485] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.457839] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.457984] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.458363] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.458647] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.458956] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-3eed3435-95b4-41f7-ab7e-2373ce84e38f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.477124] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d160efa7-0312-433f-b94f-cf7e99e24473',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.824623] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 249b36cf-74ee-44d9-b2c9-d728a30d9a09: rpc.has_security_group_logging(os_id): False [ 763.841559] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.841764] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.841850] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.842009] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.842104] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.842289] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.842385] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.842445] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.842595] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.842673] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.842858] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.842949] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.843024] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.843157] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.843230] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.843411] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.843503] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.843565] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.843708] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.843787] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.843853] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 is going to be created. [ 763.894469] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.894616] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.894693] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.894897] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.895087] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.905777] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 in Status: IN_PROGRESS for 2s [ 763.979949] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.980120] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.980201] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.980439] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.980535] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.980633] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d160efa7-0312-433f-b94f-cf7e99e24473 is going to be updated. [ 764.016510] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.016657] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.016727] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.016932] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.017078] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.025604] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d160efa7-0312-433f-b94f-cf7e99e24473 in Status: IN_PROGRESS for 2s [ 764.292850] env[68328]: INFO networking_nsxv3.common.synchronization [req-10ed5dea-922a-40ec-9ac9-804fd95d136a req-4ed5858c-6acd-44b6-8d11-55bc02b6df31 service nova] Enqueued Resource ID: d160efa7-0312-433f-b94f-cf7e99e24473 with Priority: HIGHEST for action security_group_rules [ 764.293099] env[68328]: INFO networking_nsxv3.common.synchronization [req-10ed5dea-922a-40ec-9ac9-804fd95d136a req-4ed5858c-6acd-44b6-8d11-55bc02b6df31 service nova] Enqueued Resource ID: d160efa7-0312-433f-b94f-cf7e99e24473 with Priority: HIGHEST for action security_group_members [ 764.293271] env[68328]: INFO networking_nsxv3.common.synchronization [req-10ed5dea-922a-40ec-9ac9-804fd95d136a req-4ed5858c-6acd-44b6-8d11-55bc02b6df31 service nova] Enqueued Resource ID: 3eed3435-95b4-41f7-ab7e-2373ce84e38f with Priority: HIGHEST for action port [ 764.293878] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d160efa7-0312-433f-b94f-cf7e99e24473 with Priority: HIGHEST for action security_group_rules [ 764.294032] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d160efa7-0312-433f-b94f-cf7e99e24473 with Priority: HIGHEST for action security_group_members [ 764.294178] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3eed3435-95b4-41f7-ab7e-2373ce84e38f with Priority: HIGHEST for action port [ 764.294518] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d160efa7-0312-433f-b94f-cf7e99e24473 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.294684] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.294799] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.295048] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.295155] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d160efa7-0312-433f-b94f-cf7e99e24473',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.296138] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-d160efa7-0312-433f-b94f-cf7e99e24473 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.296226] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.300629] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-3eed3435-95b4-41f7-ab7e-2373ce84e38f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.300629] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3eed3435-95b4-41f7-ab7e-2373ce84e38f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.300629] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3eed3435-95b4-41f7-ab7e-2373ce84e38f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.300629] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3eed3435-95b4-41f7-ab7e-2373ce84e38f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.300629] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3eed3435-95b4-41f7-ab7e-2373ce84e38f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.747822] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55dff300-131a-42f9-920d-f2b5a3b91449 in Status: SUCCESS [ 764.748036] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55dff300-131a-42f9-920d-f2b5a3b91449 deletion is rescheduled due to dependency. [ 764.748199] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55dff300-131a-42f9-920d-f2b5a3b91449" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.801010] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-d160efa7-0312-433f-b94f-cf7e99e24473 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.801160] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.801355] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3eed3435-95b4-41f7-ab7e-2373ce84e38f with status ACTIVE [ 764.801528] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.801636] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.801701] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.801913] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.802007] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.802186] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.802282] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.802342] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.802501] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.802578] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.802775] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.802837] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.802897] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.803047] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.803123] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.803212] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3eed3435-95b4-41f7-ab7e-2373ce84e38f is going to be updated. [ 764.825701] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.825874] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.825910] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.826122] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.826256] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.826415] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3eed3435-95b4-41f7-ab7e-2373ce84e38f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.182589] env[68328]: INFO networking_nsxv3.common.synchronization [None req-8a1c218f-60fe-4236-a75d-a7ffb8e9563f tempest-MigrationsAdminTest-1924704487 tempest-MigrationsAdminTest-1924704487-project-member] Enqueued Resource ID: b02552b8-de02-4e6a-b813-67909dbfe0c0 with Priority: HIGHEST for action security_group_rules [ 765.183209] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b02552b8-de02-4e6a-b813-67909dbfe0c0 with Priority: HIGHEST for action security_group_rules [ 765.183538] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b02552b8-de02-4e6a-b813-67909dbfe0c0 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.183727] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b02552b8-de02-4e6a-b813-67909dbfe0c0" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.183806] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b02552b8-de02-4e6a-b813-67909dbfe0c0" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.184409] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b02552b8-de02-4e6a-b813-67909dbfe0c0" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.184409] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b02552b8-de02-4e6a-b813-67909dbfe0c0',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.255719] env[68328]: INFO networking_nsxv3.common.synchronization [None req-19ed596d-70a5-4a62-89f8-920caaecad5d tempest-MigrationsAdminTest-1924704487 tempest-MigrationsAdminTest-1924704487-project-member] Enqueued Resource ID: b02552b8-de02-4e6a-b813-67909dbfe0c0 with Priority: HIGHEST for action security_group_rules [ 765.256284] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b02552b8-de02-4e6a-b813-67909dbfe0c0 with Priority: HIGHEST for action security_group_rules [ 765.256362] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b02552b8-de02-4e6a-b813-67909dbfe0c0 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.256960] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b02552b8-de02-4e6a-b813-67909dbfe0c0" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.704440] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.706993] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.706993] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.706993] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.706993] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.706993] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b02552b8-de02-4e6a-b813-67909dbfe0c0 already deleted. [ 765.706993] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b02552b8-de02-4e6a-b813-67909dbfe0c0" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.706993] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b02552b8-de02-4e6a-b813-67909dbfe0c0" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.706993] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b02552b8-de02-4e6a-b813-67909dbfe0c0" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.706993] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b02552b8-de02-4e6a-b813-67909dbfe0c0',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.917146] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 in Status: SUCCESS [ 765.917381] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.036372] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d160efa7-0312-433f-b94f-cf7e99e24473 in Status: SUCCESS [ 766.036662] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.036732] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.036950] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.037145] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.037263] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.037323] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.037503] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.037587] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.037684] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d160efa7-0312-433f-b94f-cf7e99e24473',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.225766] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.225914] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.226021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.226236] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.226325] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.226436] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b02552b8-de02-4e6a-b813-67909dbfe0c0 already deleted. [ 766.226519] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b02552b8-de02-4e6a-b813-67909dbfe0c0" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.541168] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d160efa7-0312-433f-b94f-cf7e99e24473',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.045825] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d160efa7-0312-433f-b94f-cf7e99e24473',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.548542] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.548738] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.548798] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.549042] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.549133] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.549236] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d160efa7-0312-433f-b94f-cf7e99e24473 is going to be updated. [ 767.577294] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.577546] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.577546] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.577756] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.577901] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.587204] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d160efa7-0312-433f-b94f-cf7e99e24473 in Status: IN_PROGRESS for 2s [ 769.598394] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d160efa7-0312-433f-b94f-cf7e99e24473 in Status: SUCCESS [ 769.598679] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.598868] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.599135] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.599333] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.599535] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.599535] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.599699] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.599845] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.599951] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.600061] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d160efa7-0312-433f-b94f-cf7e99e24473',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.102320] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-d160efa7-0312-433f-b94f-cf7e99e24473 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.102570] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.102570] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.102924] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.102924] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.103051] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.103083] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.103210] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.103294] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.103377] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.103644] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-d160efa7-0312-433f-b94f-cf7e99e24473 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.103644] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.103750] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.103831] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.103926] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.104020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.104076] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.104204] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.104276] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.104352] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.104437] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d160efa7-0312-433f-b94f-cf7e99e24473',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.226492] env[68328]: INFO networking_nsxv3.common.synchronization [req-4be1b524-9e87-494e-b6c9-20af19a173a4 req-2cbdeadb-7070-4c97-b7f9-fb6f969b7c2d tempest-ServerDiagnosticsNegativeTest-389669999 tempest-ServerDiagnosticsNegativeTest-389669999-project-member] Enqueued Resource ID: 61fb3384-8e34-4731-a436-48440a87fd65 with Priority: HIGHEST for action security_group_members [ 770.227056] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61fb3384-8e34-4731-a436-48440a87fd65 with Priority: HIGHEST for action security_group_members [ 770.227689] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-61fb3384-8e34-4731-a436-48440a87fd65 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.227809] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61fb3384-8e34-4731-a436-48440a87fd65" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.227873] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61fb3384-8e34-4731-a436-48440a87fd65" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.228293] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61fb3384-8e34-4731-a436-48440a87fd65" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.228478] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.228577] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.228636] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.228789] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.228865] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.228952] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('61fb3384-8e34-4731-a436-48440a87fd65',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.515855] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-739 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.515855] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-739" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.515855] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-739" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.516140] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-739" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.516301] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.516949] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.516949] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.516949] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.516949] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.517192] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 770.517327] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 770.518160] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 770.518160] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 770.518160] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 770.518160] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 770.518160] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 770.535184] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 770.535357] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 770.535494] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 770.535665] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-739" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.535961] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-ece10277-6087-4efd-bdb0-f0861946b2af taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.536136] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-ece10277-6087-4efd-bdb0-f0861946b2af" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.536254] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-ece10277-6087-4efd-bdb0-f0861946b2af" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.536553] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-ece10277-6087-4efd-bdb0-f0861946b2af" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.536695] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ece10277-6087-4efd-bdb0-f0861946b2af',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.607943] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d160efa7-0312-433f-b94f-cf7e99e24473: rpc.has_security_group_logging(os_id): False [ 770.622357] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.622504] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.622630] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.622816] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.622906] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.623520] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.623520] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.623520] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.623520] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.623520] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.623767] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.623767] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.623767] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.623878] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.623904] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.624097] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.624186] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.624237] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.624369] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.624517] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.624517] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d160efa7-0312-433f-b94f-cf7e99e24473 is going to be updated. [ 770.678884] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.679043] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.679187] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.679395] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.679567] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.691804] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d160efa7-0312-433f-b94f-cf7e99e24473 in Status: IN_PROGRESS for 2s [ 770.731294] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.731477] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.731571] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.731734] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.731872] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.732089] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.732190] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.732250] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.732403] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.732479] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.732560] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61fb3384-8e34-4731-a436-48440a87fd65 already deleted. [ 770.732637] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61fb3384-8e34-4731-a436-48440a87fd65" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.038971] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.039256] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.039428] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.039832] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.040060] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.040282] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port ece10277-6087-4efd-bdb0-f0861946b2af not found, creating... [ 771.040638] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.040855] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.041036] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.041325] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.041503] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.041846] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.042059] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.042212] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.042481] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.042666] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.042883] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: ece10277-6087-4efd-bdb0-f0861946b2af is going to be created. [ 771.068549] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.068755] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.068877] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.069164] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.069389] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.069853] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-ece10277-6087-4efd-bdb0-f0861946b2af" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.763024] env[68328]: INFO networking_nsxv3.common.synchronization [req-4be1b524-9e87-494e-b6c9-20af19a173a4 req-44dac7df-9746-4af8-9f62-a65c70747f96 service nova] Enqueued Resource ID: 61fb3384-8e34-4731-a436-48440a87fd65 with Priority: HIGHEST for action security_group_rules [ 771.763024] env[68328]: INFO networking_nsxv3.common.synchronization [req-4be1b524-9e87-494e-b6c9-20af19a173a4 req-44dac7df-9746-4af8-9f62-a65c70747f96 service nova] Enqueued Resource ID: 61fb3384-8e34-4731-a436-48440a87fd65 with Priority: HIGHEST for action security_group_members [ 771.763024] env[68328]: INFO networking_nsxv3.common.synchronization [req-4be1b524-9e87-494e-b6c9-20af19a173a4 req-44dac7df-9746-4af8-9f62-a65c70747f96 service nova] Enqueued Resource ID: ece10277-6087-4efd-bdb0-f0861946b2af with Priority: HIGHEST for action port [ 771.763024] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61fb3384-8e34-4731-a436-48440a87fd65 with Priority: HIGHEST for action security_group_rules [ 771.763024] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61fb3384-8e34-4731-a436-48440a87fd65 with Priority: HIGHEST for action security_group_members [ 771.763024] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ece10277-6087-4efd-bdb0-f0861946b2af with Priority: HIGHEST for action port [ 771.763024] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-61fb3384-8e34-4731-a436-48440a87fd65 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.763024] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-61fb3384-8e34-4731-a436-48440a87fd65" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.763024] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-61fb3384-8e34-4731-a436-48440a87fd65" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.764090] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-61fb3384-8e34-4731-a436-48440a87fd65" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.764322] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('61fb3384-8e34-4731-a436-48440a87fd65',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.766029] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-61fb3384-8e34-4731-a436-48440a87fd65 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.766029] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61fb3384-8e34-4731-a436-48440a87fd65" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.766029] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61fb3384-8e34-4731-a436-48440a87fd65" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.766029] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61fb3384-8e34-4731-a436-48440a87fd65" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.766029] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.766029] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.766029] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.766374] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.766615] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.766912] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('61fb3384-8e34-4731-a436-48440a87fd65',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.768528] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-ece10277-6087-4efd-bdb0-f0861946b2af taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.768528] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ece10277-6087-4efd-bdb0-f0861946b2af" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.768528] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ece10277-6087-4efd-bdb0-f0861946b2af" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.768528] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ece10277-6087-4efd-bdb0-f0861946b2af" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.768528] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ece10277-6087-4efd-bdb0-f0861946b2af',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.270553] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-61fb3384-8e34-4731-a436-48440a87fd65 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.270692] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61fb3384-8e34-4731-a436-48440a87fd65" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.270901] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ece10277-6087-4efd-bdb0-f0861946b2af with status ACTIVE [ 772.271096] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.271260] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.271342] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.271587] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.271639] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.271815] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.271913] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.271978] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.272151] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.272230] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.272409] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.272501] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.272563] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.272701] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.272776] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.272858] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ece10277-6087-4efd-bdb0-f0861946b2af is going to be updated. [ 772.273975] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('61fb3384-8e34-4731-a436-48440a87fd65',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.292915] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.292990] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.293092] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.293322] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.293472] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.293679] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ece10277-6087-4efd-bdb0-f0861946b2af" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.704261] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d160efa7-0312-433f-b94f-cf7e99e24473 in Status: SUCCESS [ 772.704486] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.715198] env[68328]: INFO networking_nsxv3.common.synchronization [req-01c0b27b-821e-48a0-811e-078177cfe88b req-b57d06a5-3c4b-4f78-ad78-4cb419bc9382 tempest-ServerTagsTestJSON-1558331348 tempest-ServerTagsTestJSON-1558331348-project-member] Enqueued Resource ID: 078ed1cc-5f72-48f4-8e16-b1d53057c32e with Priority: HIGHEST for action security_group_members [ 772.715467] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 078ed1cc-5f72-48f4-8e16-b1d53057c32e with Priority: HIGHEST for action security_group_members [ 772.716483] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-078ed1cc-5f72-48f4-8e16-b1d53057c32e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.716483] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-078ed1cc-5f72-48f4-8e16-b1d53057c32e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.716483] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-078ed1cc-5f72-48f4-8e16-b1d53057c32e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.716673] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-078ed1cc-5f72-48f4-8e16-b1d53057c32e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.717056] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.717056] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.717056] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.717275] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.717275] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.717275] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('078ed1cc-5f72-48f4-8e16-b1d53057c32e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.776896] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('61fb3384-8e34-4731-a436-48440a87fd65',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.118931] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-204 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.119211] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-204" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.119396] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-204" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.119758] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-204" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.120033] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.120193] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.120481] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.120747] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.120961] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.121150] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 773.121244] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 773.121342] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 773.121462] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 773.121580] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 773.121664] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 773.121800] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 773.140068] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 773.140250] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 773.140387] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 773.140608] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-204" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.140978] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-32c67e90-9974-4e0d-9a6c-184c374b39b1 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.141171] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-32c67e90-9974-4e0d-9a6c-184c374b39b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.141283] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-32c67e90-9974-4e0d-9a6c-184c374b39b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.141596] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-32c67e90-9974-4e0d-9a6c-184c374b39b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.141741] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32c67e90-9974-4e0d-9a6c-184c374b39b1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.219236] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.219236] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.219236] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.219628] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.219717] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.219973] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.220726] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.220726] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.220726] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.220726] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.220726] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 078ed1cc-5f72-48f4-8e16-b1d53057c32e already deleted. [ 773.220726] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-078ed1cc-5f72-48f4-8e16-b1d53057c32e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.279050] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.279716] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.279716] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.279716] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.279716] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.279716] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61fb3384-8e34-4731-a436-48440a87fd65 is going to be created. [ 773.303282] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.303430] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.303503] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.303743] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.303908] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.312385] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61fb3384-8e34-4731-a436-48440a87fd65 in Status: UNINITIALIZED for 2s [ 773.643979] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.645194] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.645194] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.645194] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.645194] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.645194] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 32c67e90-9974-4e0d-9a6c-184c374b39b1 not found, creating... [ 773.645399] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.645535] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.645662] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.645916] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.646083] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.646400] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.646559] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.646696] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.646909] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.647076] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.647241] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 32c67e90-9974-4e0d-9a6c-184c374b39b1 is going to be created. [ 773.666381] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.666594] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.666726] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.667040] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.667278] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.667565] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-32c67e90-9974-4e0d-9a6c-184c374b39b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.534065] env[68328]: INFO networking_nsxv3.common.synchronization [req-01c0b27b-821e-48a0-811e-078177cfe88b req-82e83acf-c5ac-47b8-af57-1c432c3782ea service nova] Enqueued Resource ID: 078ed1cc-5f72-48f4-8e16-b1d53057c32e with Priority: HIGHEST for action security_group_rules [ 774.534328] env[68328]: INFO networking_nsxv3.common.synchronization [req-01c0b27b-821e-48a0-811e-078177cfe88b req-82e83acf-c5ac-47b8-af57-1c432c3782ea service nova] Enqueued Resource ID: 078ed1cc-5f72-48f4-8e16-b1d53057c32e with Priority: HIGHEST for action security_group_members [ 774.534391] env[68328]: INFO networking_nsxv3.common.synchronization [req-01c0b27b-821e-48a0-811e-078177cfe88b req-82e83acf-c5ac-47b8-af57-1c432c3782ea service nova] Enqueued Resource ID: 32c67e90-9974-4e0d-9a6c-184c374b39b1 with Priority: HIGHEST for action port [ 774.534935] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 078ed1cc-5f72-48f4-8e16-b1d53057c32e with Priority: HIGHEST for action security_group_rules [ 774.535129] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 078ed1cc-5f72-48f4-8e16-b1d53057c32e with Priority: HIGHEST for action security_group_members [ 774.535269] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32c67e90-9974-4e0d-9a6c-184c374b39b1 with Priority: HIGHEST for action port [ 774.535620] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-078ed1cc-5f72-48f4-8e16-b1d53057c32e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.535822] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-078ed1cc-5f72-48f4-8e16-b1d53057c32e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.535861] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-078ed1cc-5f72-48f4-8e16-b1d53057c32e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.536149] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-078ed1cc-5f72-48f4-8e16-b1d53057c32e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.536261] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('078ed1cc-5f72-48f4-8e16-b1d53057c32e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.537155] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-078ed1cc-5f72-48f4-8e16-b1d53057c32e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.537292] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-078ed1cc-5f72-48f4-8e16-b1d53057c32e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.537378] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-078ed1cc-5f72-48f4-8e16-b1d53057c32e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.537606] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-078ed1cc-5f72-48f4-8e16-b1d53057c32e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.537767] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.537867] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.537956] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.538153] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.538242] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.538330] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('078ed1cc-5f72-48f4-8e16-b1d53057c32e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.543023] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-32c67e90-9974-4e0d-9a6c-184c374b39b1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.543023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32c67e90-9974-4e0d-9a6c-184c374b39b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.543023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32c67e90-9974-4e0d-9a6c-184c374b39b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.543023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32c67e90-9974-4e0d-9a6c-184c374b39b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.543023] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32c67e90-9974-4e0d-9a6c-184c374b39b1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.041737] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('078ed1cc-5f72-48f4-8e16-b1d53057c32e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.043122] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-078ed1cc-5f72-48f4-8e16-b1d53057c32e taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.043235] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-078ed1cc-5f72-48f4-8e16-b1d53057c32e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.044723] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 32c67e90-9974-4e0d-9a6c-184c374b39b1 with status ACTIVE [ 775.044895] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.045037] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.045082] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.045426] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.045426] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.045641] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.045745] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.045807] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.045967] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.046063] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.046236] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.046346] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.046395] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.046514] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.046590] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.046670] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 32c67e90-9974-4e0d-9a6c-184c374b39b1 is going to be updated. [ 775.066120] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.066313] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.066313] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.067053] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.067216] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.067385] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32c67e90-9974-4e0d-9a6c-184c374b39b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.321352] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61fb3384-8e34-4731-a436-48440a87fd65 in Status: SUCCESS [ 775.321715] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61fb3384-8e34-4731-a436-48440a87fd65" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.321744] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61fb3384-8e34-4731-a436-48440a87fd65" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.321990] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61fb3384-8e34-4731-a436-48440a87fd65" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.322229] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.322328] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.322395] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.322591] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.322622] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.322759] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61fb3384-8e34-4731-a436-48440a87fd65" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.322793] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('61fb3384-8e34-4731-a436-48440a87fd65',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.410318] env[68328]: INFO networking_nsxv3.common.synchronization [req-822ca1f3-d666-4903-b464-aceb0fa01280 req-4d935e71-68a6-4b02-b62a-58550234cba0 tempest-ServersAdminTestJSON-340534059 tempest-ServersAdminTestJSON-340534059-project-member] Enqueued Resource ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed with Priority: HIGHEST for action security_group_members [ 775.410879] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed with Priority: HIGHEST for action security_group_members [ 775.411245] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.411388] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.411458] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.411690] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.411863] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.411968] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.413062] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.413255] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.413349] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.413448] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.544657] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('078ed1cc-5f72-48f4-8e16-b1d53057c32e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.827510] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-61fb3384-8e34-4731-a436-48440a87fd65 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.827680] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61fb3384-8e34-4731-a436-48440a87fd65" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.827801] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61fb3384-8e34-4731-a436-48440a87fd65" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.827984] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61fb3384-8e34-4731-a436-48440a87fd65" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.828170] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.828267] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.828324] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.828479] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.828641] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.828641] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61fb3384-8e34-4731-a436-48440a87fd65" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.828790] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-61fb3384-8e34-4731-a436-48440a87fd65 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.828878] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61fb3384-8e34-4731-a436-48440a87fd65" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.828942] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61fb3384-8e34-4731-a436-48440a87fd65" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.829089] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61fb3384-8e34-4731-a436-48440a87fd65" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.829223] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.829315] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.829364] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.829496] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.829791] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.829911] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61fb3384-8e34-4731-a436-48440a87fd65" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.830027] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('61fb3384-8e34-4731-a436-48440a87fd65',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.838105] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-847 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.838295] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-847" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.838416] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-847" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.838737] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-847" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.838901] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.839073] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.839191] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.839701] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.839701] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.839801] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 775.839910] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 775.840026] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 775.840132] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 775.840245] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 775.840347] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 775.840476] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 775.871268] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 775.871615] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 775.871882] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 775.873411] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-847" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.873411] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-ca64754c-a53c-43a8-ac2f-a32fa67e4581 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.873411] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-ca64754c-a53c-43a8-ac2f-a32fa67e4581" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.873411] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-ca64754c-a53c-43a8-ac2f-a32fa67e4581" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.873411] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-ca64754c-a53c-43a8-ac2f-a32fa67e4581" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.873411] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca64754c-a53c-43a8-ac2f-a32fa67e4581',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.914899] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.047217] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.047419] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.047542] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.047771] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.047878] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.047997] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 078ed1cc-5f72-48f4-8e16-b1d53057c32e is going to be created. [ 776.072107] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.072303] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.072416] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.072694] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.072927] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.082773] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 078ed1cc-5f72-48f4-8e16-b1d53057c32e in Status: UNINITIALIZED for 2s [ 776.332981] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 61fb3384-8e34-4731-a436-48440a87fd65: rpc.has_security_group_logging(os_id): False [ 776.351537] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.351537] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.351537] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.351537] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.351537] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.351537] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.352354] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.352546] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.352798] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.352958] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.353297] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.353525] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.353611] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.353783] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.353870] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.354142] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.354283] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.354348] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.354518] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.356019] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.356019] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 61fb3384-8e34-4731-a436-48440a87fd65 is going to be created. [ 776.376764] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.377069] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.377238] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.377532] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.377715] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.377877] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port ca64754c-a53c-43a8-ac2f-a32fa67e4581 not found, creating... [ 776.378182] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.378352] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.378469] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.378726] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.378910] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.379229] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.379411] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.379594] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.379829] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.381454] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.381454] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: ca64754c-a53c-43a8-ac2f-a32fa67e4581 is going to be created. [ 776.398655] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.399052] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.399164] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.399464] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.399792] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.400098] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-ca64754c-a53c-43a8-ac2f-a32fa67e4581" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.409028] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.409207] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.409285] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.409500] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.409713] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.417435] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.420818] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 61fb3384-8e34-4731-a436-48440a87fd65 in Status: IN_PROGRESS for 2s [ 776.920367] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.920644] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.920644] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.920903] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.921064] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.921212] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed is going to be updated. [ 776.950891] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.950891] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.950891] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.953232] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.953391] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.962826] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed in Status: IN_PROGRESS for 2s [ 777.355799] env[68328]: INFO networking_nsxv3.common.synchronization [req-822ca1f3-d666-4903-b464-aceb0fa01280 req-dbc8929f-59e2-4a5a-bf5d-d60476b0ca2c service nova] Enqueued Resource ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed with Priority: HIGHEST for action security_group_rules [ 777.356079] env[68328]: INFO networking_nsxv3.common.synchronization [req-822ca1f3-d666-4903-b464-aceb0fa01280 req-dbc8929f-59e2-4a5a-bf5d-d60476b0ca2c service nova] Enqueued Resource ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed with Priority: HIGHEST for action security_group_members [ 777.356309] env[68328]: INFO networking_nsxv3.common.synchronization [req-822ca1f3-d666-4903-b464-aceb0fa01280 req-dbc8929f-59e2-4a5a-bf5d-d60476b0ca2c service nova] Enqueued Resource ID: ca64754c-a53c-43a8-ac2f-a32fa67e4581 with Priority: HIGHEST for action port [ 777.356989] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed with Priority: HIGHEST for action security_group_rules [ 777.358177] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed with Priority: HIGHEST for action security_group_members [ 777.358358] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca64754c-a53c-43a8-ac2f-a32fa67e4581 with Priority: HIGHEST for action port [ 777.358759] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.359058] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.359058] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.359718] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.359718] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.361818] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.362034] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.362257] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca64754c-a53c-43a8-ac2f-a32fa67e4581 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.362382] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca64754c-a53c-43a8-ac2f-a32fa67e4581" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.362442] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca64754c-a53c-43a8-ac2f-a32fa67e4581" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.362675] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca64754c-a53c-43a8-ac2f-a32fa67e4581" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.362810] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca64754c-a53c-43a8-ac2f-a32fa67e4581',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.865056] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.865234] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.865340] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ca64754c-a53c-43a8-ac2f-a32fa67e4581 with status ACTIVE [ 777.865511] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.865636] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.865704] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.865917] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.866014] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.866186] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.866278] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.866354] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.866560] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.866594] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.866752] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.866843] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.866903] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.867086] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.867162] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.867243] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ca64754c-a53c-43a8-ac2f-a32fa67e4581 is going to be updated. [ 777.886876] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.887097] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.887097] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.887297] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.887440] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.887641] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca64754c-a53c-43a8-ac2f-a32fa67e4581" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.091945] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 078ed1cc-5f72-48f4-8e16-b1d53057c32e in Status: SUCCESS [ 778.092385] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-078ed1cc-5f72-48f4-8e16-b1d53057c32e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.092442] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-078ed1cc-5f72-48f4-8e16-b1d53057c32e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.092686] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-078ed1cc-5f72-48f4-8e16-b1d53057c32e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.092940] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.093109] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.093195] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.093408] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.093517] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.093636] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-078ed1cc-5f72-48f4-8e16-b1d53057c32e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.093757] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('078ed1cc-5f72-48f4-8e16-b1d53057c32e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.434626] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 61fb3384-8e34-4731-a436-48440a87fd65 in Status: SUCCESS [ 778.434854] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-61fb3384-8e34-4731-a436-48440a87fd65" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.596706] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-078ed1cc-5f72-48f4-8e16-b1d53057c32e taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.596951] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-078ed1cc-5f72-48f4-8e16-b1d53057c32e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.597128] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-078ed1cc-5f72-48f4-8e16-b1d53057c32e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.597474] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-078ed1cc-5f72-48f4-8e16-b1d53057c32e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.597776] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.597953] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.598089] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.598336] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.598507] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.598660] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-078ed1cc-5f72-48f4-8e16-b1d53057c32e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.598896] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-078ed1cc-5f72-48f4-8e16-b1d53057c32e taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.599013] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-078ed1cc-5f72-48f4-8e16-b1d53057c32e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.599096] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-078ed1cc-5f72-48f4-8e16-b1d53057c32e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.599274] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-078ed1cc-5f72-48f4-8e16-b1d53057c32e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.599419] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.599512] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.599613] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.599761] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.599841] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.599925] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-078ed1cc-5f72-48f4-8e16-b1d53057c32e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.600073] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('078ed1cc-5f72-48f4-8e16-b1d53057c32e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.973203] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed in Status: SUCCESS [ 778.973546] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.973890] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.974214] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.974507] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.974682] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.974782] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.975060] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.975202] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.975355] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.102988] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 078ed1cc-5f72-48f4-8e16-b1d53057c32e: rpc.has_security_group_logging(os_id): False [ 779.126146] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.126439] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.126439] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.126600] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.126653] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.126874] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.127019] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.127075] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.127222] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.127344] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.127471] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.127599] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.127671] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.127805] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.127881] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.128076] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.128192] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.128267] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.128394] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.128464] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.128550] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 078ed1cc-5f72-48f4-8e16-b1d53057c32e is going to be created. [ 779.184307] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.184583] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.184689] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.185027] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.185336] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.196151] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 078ed1cc-5f72-48f4-8e16-b1d53057c32e in Status: IN_PROGRESS for 2s [ 779.478280] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.981098] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.484029] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.484029] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.484029] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.484029] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.484029] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.484029] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed is going to be updated. [ 780.514154] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.514325] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.514397] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.515028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.515028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.523587] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed in Status: IN_PROGRESS for 2s [ 781.212131] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 078ed1cc-5f72-48f4-8e16-b1d53057c32e in Status: SUCCESS [ 781.212502] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-078ed1cc-5f72-48f4-8e16-b1d53057c32e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.359749] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 782.360061] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 782.558491] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed in Status: SUCCESS [ 782.558737] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.558957] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.559205] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.559408] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.559528] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.559664] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.559841] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.559925] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.560042] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.560214] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.066533] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.066796] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.066796] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.066955] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.067216] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.067326] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.067391] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.067556] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.067654] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.067787] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.067941] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.068064] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.068134] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.068279] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.068458] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.068576] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.068638] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.068779] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.068855] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.068948] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.069663] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.571614] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed: rpc.has_security_group_logging(os_id): False [ 783.590194] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.590413] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.590413] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.590619] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.590715] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.591018] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.591154] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.591220] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.591386] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.591468] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.591737] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.591874] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.592357] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.592357] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.592357] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.592357] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.592565] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.592565] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.592810] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.592861] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.593024] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed is going to be updated. [ 783.655052] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.655253] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.655299] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.655551] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.655704] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.667720] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed in Status: IN_PROGRESS for 2s [ 785.680807] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed in Status: SUCCESS [ 785.681265] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.361047] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 787.361331] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 788.593292] env[68328]: INFO networking_nsxv3.common.synchronization [req-491bb0a1-ec99-4561-b02a-cbd0c758f1b8 req-4ba54fc4-1e05-425d-822c-7fc377c27d6d tempest-ImagesTestJSON-69996350 tempest-ImagesTestJSON-69996350-project-member] Enqueued Resource ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 with Priority: HIGHEST for action security_group_members [ 788.594108] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 with Priority: HIGHEST for action security_group_members [ 788.594486] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-249b36cf-74ee-44d9-b2c9-d728a30d9a09 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.594643] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.594754] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.595034] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.595366] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.595366] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.595495] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.595930] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.596067] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.597318] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('249b36cf-74ee-44d9-b2c9-d728a30d9a09',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.892021] env[68328]: INFO networking_nsxv3.common.synchronization [req-0b24947a-092b-49f2-a247-8a204169330b req-eafe70d3-afbb-450f-81a4-e101ad052031 tempest-ServerDiagnosticsNegativeTest-389669999 tempest-ServerDiagnosticsNegativeTest-389669999-project-member] Enqueued Resource ID: 61fb3384-8e34-4731-a436-48440a87fd65 with Priority: HIGHEST for action security_group_members [ 788.892021] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61fb3384-8e34-4731-a436-48440a87fd65 with Priority: HIGHEST for action security_group_members [ 788.892021] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-61fb3384-8e34-4731-a436-48440a87fd65 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.892021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61fb3384-8e34-4731-a436-48440a87fd65" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.892021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61fb3384-8e34-4731-a436-48440a87fd65" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.892394] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61fb3384-8e34-4731-a436-48440a87fd65" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.892560] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.892668] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.892728] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.892879] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.892962] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.893063] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('61fb3384-8e34-4731-a436-48440a87fd65',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.100606] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.100851] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.100923] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.101185] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.101278] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.101480] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.101576] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.101638] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.101795] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.101860] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.101944] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 is going to be updated. [ 789.132060] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.132298] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.132352] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.132584] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.132726] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.142513] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 in Status: IN_PROGRESS for 2s [ 789.396029] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.396029] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.396029] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.396029] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.396029] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.396029] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.396029] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.396426] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.396426] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.396426] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.396609] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61fb3384-8e34-4731-a436-48440a87fd65 is going to be updated. [ 789.423094] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.423281] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.423361] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.423628] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.424711] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.433388] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61fb3384-8e34-4731-a436-48440a87fd65 in Status: IN_PROGRESS for 2s [ 789.971039] env[68328]: INFO networking_nsxv3.common.synchronization [req-c4a7b1fd-98a1-451d-93d7-8208f5538ccb req-9d4f6df0-c241-4aca-909f-3a89c376e738 tempest-AttachInterfacesV270Test-309391658 tempest-AttachInterfacesV270Test-309391658-project-member] Enqueued Resource ID: b95bc2dc-a214-45b1-8103-2bccad318c7b with Priority: HIGHEST for action security_group_members [ 789.972027] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b95bc2dc-a214-45b1-8103-2bccad318c7b with Priority: HIGHEST for action security_group_members [ 789.972027] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b95bc2dc-a214-45b1-8103-2bccad318c7b taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.972027] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b95bc2dc-a214-45b1-8103-2bccad318c7b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.972229] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b95bc2dc-a214-45b1-8103-2bccad318c7b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.972323] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b95bc2dc-a214-45b1-8103-2bccad318c7b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.972484] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.972584] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.972651] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.972806] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.972898] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.972990] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b95bc2dc-a214-45b1-8103-2bccad318c7b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.308543] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-810 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.308736] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-810" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.308857] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-810" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.309244] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-810" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.309527] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.309696] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.309849] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.310113] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.310260] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.310472] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 790.310580] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 790.310684] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 790.310788] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 790.310890] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 790.310991] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 790.311238] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 790.332243] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 790.332352] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 790.332493] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 790.332673] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-810" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.333020] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-85aeafd5-3bcb-4d9e-ad12-78647563bf59 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.333207] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-85aeafd5-3bcb-4d9e-ad12-78647563bf59" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.337022] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-85aeafd5-3bcb-4d9e-ad12-78647563bf59" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.337022] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-85aeafd5-3bcb-4d9e-ad12-78647563bf59" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.337022] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85aeafd5-3bcb-4d9e-ad12-78647563bf59',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.475407] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.475570] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.475643] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.475864] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.475959] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.476196] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.476284] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.476322] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.476530] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.476530] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.476587] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b95bc2dc-a214-45b1-8103-2bccad318c7b already deleted. [ 790.476665] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b95bc2dc-a214-45b1-8103-2bccad318c7b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.743617] env[68328]: INFO networking_nsxv3.common.synchronization [req-9e8843cb-e121-43ea-8df3-277b57d34d96 req-853549fb-14e9-4e25-8c9b-aba70fff8c49 tempest-ServerTagsTestJSON-1558331348 tempest-ServerTagsTestJSON-1558331348-project-member] Enqueued Resource ID: 078ed1cc-5f72-48f4-8e16-b1d53057c32e with Priority: HIGHEST for action security_group_members [ 790.744172] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 078ed1cc-5f72-48f4-8e16-b1d53057c32e with Priority: HIGHEST for action security_group_members [ 790.744469] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-078ed1cc-5f72-48f4-8e16-b1d53057c32e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.744586] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-078ed1cc-5f72-48f4-8e16-b1d53057c32e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.744645] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-078ed1cc-5f72-48f4-8e16-b1d53057c32e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.744837] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-078ed1cc-5f72-48f4-8e16-b1d53057c32e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.744983] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.745404] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.745470] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.745629] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.745716] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.745810] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('078ed1cc-5f72-48f4-8e16-b1d53057c32e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.842023] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.842023] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.842023] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.842023] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.842023] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.842023] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 85aeafd5-3bcb-4d9e-ad12-78647563bf59 not found, creating... [ 790.842023] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.842023] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.842023] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.842023] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.842023] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.842801] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.842801] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.842801] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.842801] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.842801] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.842801] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 85aeafd5-3bcb-4d9e-ad12-78647563bf59 is going to be created. [ 790.862091] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.862454] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.862585] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.862879] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.863199] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.863432] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-85aeafd5-3bcb-4d9e-ad12-78647563bf59" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.152541] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 in Status: SUCCESS [ 791.152789] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 deletion is rescheduled due to dependency. [ 791.152878] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.247690] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.247834] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.247926] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.248166] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.248263] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.248466] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.248604] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.248641] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.248765] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.248856] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.248930] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 078ed1cc-5f72-48f4-8e16-b1d53057c32e is going to be updated. [ 791.275823] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.275989] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.276074] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.276295] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.276433] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.285350] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 078ed1cc-5f72-48f4-8e16-b1d53057c32e in Status: IN_PROGRESS for 2s [ 791.444882] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61fb3384-8e34-4731-a436-48440a87fd65 in Status: SUCCESS [ 791.445058] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61fb3384-8e34-4731-a436-48440a87fd65 deletion is rescheduled due to dependency. [ 791.445200] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61fb3384-8e34-4731-a436-48440a87fd65" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.578750] env[68328]: INFO networking_nsxv3.common.synchronization [req-c4a7b1fd-98a1-451d-93d7-8208f5538ccb req-6590f236-d6f3-4e8c-a096-7290770dbd15 service nova] Enqueued Resource ID: b95bc2dc-a214-45b1-8103-2bccad318c7b with Priority: HIGHEST for action security_group_rules [ 791.578951] env[68328]: INFO networking_nsxv3.common.synchronization [req-c4a7b1fd-98a1-451d-93d7-8208f5538ccb req-6590f236-d6f3-4e8c-a096-7290770dbd15 service nova] Enqueued Resource ID: b95bc2dc-a214-45b1-8103-2bccad318c7b with Priority: HIGHEST for action security_group_members [ 791.579178] env[68328]: INFO networking_nsxv3.common.synchronization [req-c4a7b1fd-98a1-451d-93d7-8208f5538ccb req-6590f236-d6f3-4e8c-a096-7290770dbd15 service nova] Enqueued Resource ID: 85aeafd5-3bcb-4d9e-ad12-78647563bf59 with Priority: HIGHEST for action port [ 791.579577] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b95bc2dc-a214-45b1-8103-2bccad318c7b with Priority: HIGHEST for action security_group_rules [ 791.579840] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b95bc2dc-a214-45b1-8103-2bccad318c7b with Priority: HIGHEST for action security_group_members [ 791.579913] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85aeafd5-3bcb-4d9e-ad12-78647563bf59 with Priority: HIGHEST for action port [ 791.580319] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b95bc2dc-a214-45b1-8103-2bccad318c7b taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.580319] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b95bc2dc-a214-45b1-8103-2bccad318c7b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.580445] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b95bc2dc-a214-45b1-8103-2bccad318c7b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.580670] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b95bc2dc-a214-45b1-8103-2bccad318c7b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.580780] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b95bc2dc-a214-45b1-8103-2bccad318c7b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.581630] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b95bc2dc-a214-45b1-8103-2bccad318c7b taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.581705] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b95bc2dc-a214-45b1-8103-2bccad318c7b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.581768] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b95bc2dc-a214-45b1-8103-2bccad318c7b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.581932] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b95bc2dc-a214-45b1-8103-2bccad318c7b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.582251] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.582341] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.582381] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.582643] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.582643] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.582643] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b95bc2dc-a214-45b1-8103-2bccad318c7b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.587020] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-85aeafd5-3bcb-4d9e-ad12-78647563bf59 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.587020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-85aeafd5-3bcb-4d9e-ad12-78647563bf59" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.587020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-85aeafd5-3bcb-4d9e-ad12-78647563bf59" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.587020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-85aeafd5-3bcb-4d9e-ad12-78647563bf59" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.587020] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85aeafd5-3bcb-4d9e-ad12-78647563bf59',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.085806] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b95bc2dc-a214-45b1-8103-2bccad318c7b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.087074] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b95bc2dc-a214-45b1-8103-2bccad318c7b taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.087074] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b95bc2dc-a214-45b1-8103-2bccad318c7b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.087412] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 85aeafd5-3bcb-4d9e-ad12-78647563bf59 with status ACTIVE [ 792.087578] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.088216] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.088216] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.088216] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.088216] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.088422] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.088422] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.088422] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.088540] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.088613] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.088785] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.088912] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.088941] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.089126] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.090324] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.090324] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 85aeafd5-3bcb-4d9e-ad12-78647563bf59 is going to be updated. [ 792.111943] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.111943] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.112136] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.112303] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.112484] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.114575] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-85aeafd5-3bcb-4d9e-ad12-78647563bf59" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.587964] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b95bc2dc-a214-45b1-8103-2bccad318c7b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.090897] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.090897] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.090897] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.090897] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.090897] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.090897] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b95bc2dc-a214-45b1-8103-2bccad318c7b is going to be created. [ 793.115121] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.115121] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.115121] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.115121] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.115121] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.123976] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b95bc2dc-a214-45b1-8103-2bccad318c7b in Status: UNINITIALIZED for 2s [ 793.295150] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 078ed1cc-5f72-48f4-8e16-b1d53057c32e in Status: SUCCESS [ 793.295150] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 078ed1cc-5f72-48f4-8e16-b1d53057c32e deletion is rescheduled due to dependency. [ 793.295150] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-078ed1cc-5f72-48f4-8e16-b1d53057c32e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.498907] env[68328]: INFO networking_nsxv3.common.synchronization [req-c35ee98a-0a9f-440c-87b9-4b6ad4174cd2 req-87b4f44c-78f2-4e2f-a03a-98e337756c8a tempest-ImagesOneServerNegativeTestJSON-288072164 tempest-ImagesOneServerNegativeTestJSON-288072164-project-member] Enqueued Resource ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 with Priority: HIGHEST for action security_group_members [ 794.499619] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 with Priority: HIGHEST for action security_group_members [ 794.502762] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-55f209f1-d8fe-4d5e-a886-797753b1b3c1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.504024] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.504024] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.504149] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.504329] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.504436] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.504519] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.504689] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.504786] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.504880] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55f209f1-d8fe-4d5e-a886-797753b1b3c1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.684090] env[68328]: INFO networking_nsxv3.common.synchronization [None req-d6626c05-21c1-430c-bd0d-52f3ca97bcf1 None None] Enqueued Resource ID: 25b73ead-daa0-4cf1-b4c6-21deaf282dc6 with Priority: HIGHEST for action port [ 794.686078] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25b73ead-daa0-4cf1-b4c6-21deaf282dc6 with Priority: HIGHEST for action port [ 794.686078] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-25b73ead-daa0-4cf1-b4c6-21deaf282dc6 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.687600] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-25b73ead-daa0-4cf1-b4c6-21deaf282dc6" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.687760] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-25b73ead-daa0-4cf1-b4c6-21deaf282dc6" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.688877] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-25b73ead-daa0-4cf1-b4c6-21deaf282dc6" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.688999] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25b73ead-daa0-4cf1-b4c6-21deaf282dc6',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.006815] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.007031] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.007164] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.007426] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.007573] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.007817] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.007927] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.007992] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.008287] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.008383] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.008477] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 already deleted. [ 795.008559] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.134122] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b95bc2dc-a214-45b1-8103-2bccad318c7b in Status: UNINITIALIZED for 4s [ 795.192645] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 25b73ead-daa0-4cf1-b4c6-21deaf282dc6 [ 795.192915] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.193063] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.193139] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.193525] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.193695] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.197189] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:25b73ead-daa0-4cf1-b4c6-21deaf282dc6 already deleted. [ 795.198726] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-25b73ead-daa0-4cf1-b4c6-21deaf282dc6" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.204940] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-925 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.205152] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-925" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.205279] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-925" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.205635] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-925" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.205866] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.208516] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.208732] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.208999] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.209325] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.209596] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 795.209734] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 795.209838] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 795.209948] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 795.210070] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 795.210180] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 795.210319] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 795.232583] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 795.232583] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 795.232583] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 795.232583] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-925" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.232583] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-2b9d7ce4-0e12-422f-b5e0-54d7f695205d taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.232583] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-2b9d7ce4-0e12-422f-b5e0-54d7f695205d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.232583] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-2b9d7ce4-0e12-422f-b5e0-54d7f695205d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.232583] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-2b9d7ce4-0e12-422f-b5e0-54d7f695205d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.233268] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b9d7ce4-0e12-422f-b5e0-54d7f695205d',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.735570] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.736929] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.736929] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.736929] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.736929] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.736929] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 2b9d7ce4-0e12-422f-b5e0-54d7f695205d not found, creating... [ 795.737362] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.737730] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.737730] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.738325] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.738531] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.738871] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.739132] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.739289] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.740091] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.741423] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.741671] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 2b9d7ce4-0e12-422f-b5e0-54d7f695205d is going to be created. [ 795.761306] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.761306] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.761306] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.761576] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.761802] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.762048] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-2b9d7ce4-0e12-422f-b5e0-54d7f695205d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.598848] env[68328]: INFO networking_nsxv3.common.synchronization [req-c35ee98a-0a9f-440c-87b9-4b6ad4174cd2 req-0f23a2fc-5361-4f47-9565-3c973c7ee88c service nova] Enqueued Resource ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 with Priority: HIGHEST for action security_group_rules [ 796.598848] env[68328]: INFO networking_nsxv3.common.synchronization [req-c35ee98a-0a9f-440c-87b9-4b6ad4174cd2 req-0f23a2fc-5361-4f47-9565-3c973c7ee88c service nova] Enqueued Resource ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 with Priority: HIGHEST for action security_group_members [ 796.598848] env[68328]: INFO networking_nsxv3.common.synchronization [req-c35ee98a-0a9f-440c-87b9-4b6ad4174cd2 req-0f23a2fc-5361-4f47-9565-3c973c7ee88c service nova] Enqueued Resource ID: 2b9d7ce4-0e12-422f-b5e0-54d7f695205d with Priority: HIGHEST for action port [ 796.598848] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 with Priority: HIGHEST for action security_group_rules [ 796.598848] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 with Priority: HIGHEST for action security_group_members [ 796.598848] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b9d7ce4-0e12-422f-b5e0-54d7f695205d with Priority: HIGHEST for action port [ 796.599147] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55f209f1-d8fe-4d5e-a886-797753b1b3c1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.599849] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.599849] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.599849] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.600137] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55f209f1-d8fe-4d5e-a886-797753b1b3c1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.601282] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-55f209f1-d8fe-4d5e-a886-797753b1b3c1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.601679] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.601679] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.602078] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.602078] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.602078] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.602078] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.602614] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.602614] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.602614] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55f209f1-d8fe-4d5e-a886-797753b1b3c1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.604276] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b9d7ce4-0e12-422f-b5e0-54d7f695205d taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.606980] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b9d7ce4-0e12-422f-b5e0-54d7f695205d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.606980] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b9d7ce4-0e12-422f-b5e0-54d7f695205d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.606980] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b9d7ce4-0e12-422f-b5e0-54d7f695205d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.606980] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b9d7ce4-0e12-422f-b5e0-54d7f695205d',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.827376] env[68328]: INFO networking_nsxv3.common.synchronization [req-5176bd9b-70fd-4c14-b74a-aa140269c713 req-398b4e0c-fc19-4adf-822d-278c2a6c1996 tempest-FloatingIPsAssociationNegativeTestJSON-979815897 tempest-FloatingIPsAssociationNegativeTestJSON-979815897-project-member] Enqueued Resource ID: f0811b65-cde4-4246-a2e0-5bbd90921f5b with Priority: HIGHEST for action security_group_members [ 796.828246] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0811b65-cde4-4246-a2e0-5bbd90921f5b with Priority: HIGHEST for action security_group_members [ 796.828338] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0811b65-cde4-4246-a2e0-5bbd90921f5b taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.828467] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0811b65-cde4-4246-a2e0-5bbd90921f5b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.828535] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0811b65-cde4-4246-a2e0-5bbd90921f5b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.828784] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0811b65-cde4-4246-a2e0-5bbd90921f5b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.829026] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.829107] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.829139] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.829281] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.829457] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.829457] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0811b65-cde4-4246-a2e0-5bbd90921f5b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.980249] env[68328]: INFO networking_nsxv3.common.synchronization [None req-a59158dd-f0c2-4339-97e5-1fa13e758017 None None] Enqueued Resource ID: bb3ddc0f-ce4c-4c45-9de1-e9181d8c1df7 with Priority: HIGHEST for action port [ 796.980249] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb3ddc0f-ce4c-4c45-9de1-e9181d8c1df7 with Priority: HIGHEST for action port [ 796.981126] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb3ddc0f-ce4c-4c45-9de1-e9181d8c1df7 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.981466] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb3ddc0f-ce4c-4c45-9de1-e9181d8c1df7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.983027] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb3ddc0f-ce4c-4c45-9de1-e9181d8c1df7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.983027] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb3ddc0f-ce4c-4c45-9de1-e9181d8c1df7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.983027] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb3ddc0f-ce4c-4c45-9de1-e9181d8c1df7',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.104479] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55f209f1-d8fe-4d5e-a886-797753b1b3c1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.106808] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-55f209f1-d8fe-4d5e-a886-797753b1b3c1 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.107026] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.107222] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2b9d7ce4-0e12-422f-b5e0-54d7f695205d with status ACTIVE [ 797.107645] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.108041] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.108526] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.108857] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.112910] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.112910] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.112910] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.112910] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.113124] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.113124] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.113641] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.113641] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.113641] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.113844] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.113924] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.114046] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2b9d7ce4-0e12-422f-b5e0-54d7f695205d is going to be updated. [ 797.140246] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.140409] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.140409] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.140605] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.140755] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.141368] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b9d7ce4-0e12-422f-b5e0-54d7f695205d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.146995] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b95bc2dc-a214-45b1-8103-2bccad318c7b in Status: SUCCESS [ 797.148130] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b95bc2dc-a214-45b1-8103-2bccad318c7b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.148130] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b95bc2dc-a214-45b1-8103-2bccad318c7b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.148130] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b95bc2dc-a214-45b1-8103-2bccad318c7b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.148130] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.148335] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.148335] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.148521] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.148558] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.148761] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b95bc2dc-a214-45b1-8103-2bccad318c7b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.148761] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b95bc2dc-a214-45b1-8103-2bccad318c7b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.165867] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-763 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.166099] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-763" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.166319] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-763" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.166580] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-763" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.166851] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.170395] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.170556] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.170865] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.171400] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.171400] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 797.171400] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 797.171588] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 797.171588] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 797.171786] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 797.171786] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 797.171934] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 797.192818] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 797.192818] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 797.192818] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 797.192818] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-763" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.192818] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-d37081bf-aeeb-4982-893d-4f85b7150d03 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.192818] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-d37081bf-aeeb-4982-893d-4f85b7150d03" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.193077] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-d37081bf-aeeb-4982-893d-4f85b7150d03" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.193911] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-d37081bf-aeeb-4982-893d-4f85b7150d03" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.193911] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d37081bf-aeeb-4982-893d-4f85b7150d03',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.332758] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.334203] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.334203] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.334203] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.334203] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.334203] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.334203] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.334203] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.334545] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.334545] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.334662] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0811b65-cde4-4246-a2e0-5bbd90921f5b already deleted. [ 797.334787] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0811b65-cde4-4246-a2e0-5bbd90921f5b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.488338] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bb3ddc0f-ce4c-4c45-9de1-e9181d8c1df7 [ 797.488602] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.488731] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.488792] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.489392] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.489392] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.489392] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bb3ddc0f-ce4c-4c45-9de1-e9181d8c1df7 already deleted. [ 797.489392] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb3ddc0f-ce4c-4c45-9de1-e9181d8c1df7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.608117] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55f209f1-d8fe-4d5e-a886-797753b1b3c1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.651292] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b95bc2dc-a214-45b1-8103-2bccad318c7b taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.651461] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b95bc2dc-a214-45b1-8103-2bccad318c7b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.651550] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b95bc2dc-a214-45b1-8103-2bccad318c7b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.651778] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b95bc2dc-a214-45b1-8103-2bccad318c7b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.651980] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.653776] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.653893] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.654094] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.654271] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.654336] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b95bc2dc-a214-45b1-8103-2bccad318c7b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.654480] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b95bc2dc-a214-45b1-8103-2bccad318c7b taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.654578] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b95bc2dc-a214-45b1-8103-2bccad318c7b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.654827] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b95bc2dc-a214-45b1-8103-2bccad318c7b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.654871] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b95bc2dc-a214-45b1-8103-2bccad318c7b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.655347] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.655347] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.655347] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.655347] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.655508] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.655508] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b95bc2dc-a214-45b1-8103-2bccad318c7b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.655571] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b95bc2dc-a214-45b1-8103-2bccad318c7b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.701545] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.701787] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.702135] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.702302] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.702375] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.702503] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port d37081bf-aeeb-4982-893d-4f85b7150d03 not found, creating... [ 797.702801] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.703736] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.703736] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.703736] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.703736] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.703736] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.704071] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.704071] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.707515] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.707515] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.707515] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: d37081bf-aeeb-4982-893d-4f85b7150d03 is going to be created. [ 797.708926] env[68328]: INFO networking_nsxv3.common.synchronization [req-275f13b5-69fa-42c1-a6e9-36623f31134e req-e5a6bf34-2ccd-416e-a9f6-e50142602c6c tempest-ServersWithSpecificFlavorTestJSON-2033217338 tempest-ServersWithSpecificFlavorTestJSON-2033217338-project-member] Enqueued Resource ID: 3e399462-679e-43d6-8b03-2876938fc726 with Priority: HIGHEST for action security_group_members [ 797.709965] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e399462-679e-43d6-8b03-2876938fc726 with Priority: HIGHEST for action security_group_members [ 797.710311] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e399462-679e-43d6-8b03-2876938fc726 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.710425] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.710490] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.710708] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.710913] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.711029] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.711087] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.711245] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.711324] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.711414] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e399462-679e-43d6-8b03-2876938fc726',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.727768] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.728045] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.728191] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.728522] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.728820] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.729163] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-d37081bf-aeeb-4982-893d-4f85b7150d03" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.971332] env[68328]: INFO networking_nsxv3.common.synchronization [None req-19fc3e3a-ba25-4342-91f8-32149733537b None None] Enqueued Resource ID: e9d6be64-6e54-486c-a813-4a74669ae10e with Priority: HIGHEST for action port [ 797.972136] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9d6be64-6e54-486c-a813-4a74669ae10e with Priority: HIGHEST for action port [ 797.972377] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9d6be64-6e54-486c-a813-4a74669ae10e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.972438] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9d6be64-6e54-486c-a813-4a74669ae10e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.972470] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9d6be64-6e54-486c-a813-4a74669ae10e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.972929] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9d6be64-6e54-486c-a813-4a74669ae10e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.972929] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9d6be64-6e54-486c-a813-4a74669ae10e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.114334] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.114334] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.114334] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.114334] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.114334] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.114334] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 is going to be created. [ 798.134790] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.134790] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.134790] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.134790] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.134790] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.144187] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 in Status: UNINITIALIZED for 2s [ 798.166979] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b95bc2dc-a214-45b1-8103-2bccad318c7b: rpc.has_security_group_logging(os_id): False [ 798.183240] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.183404] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.183472] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.183644] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.183730] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.183921] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.184046] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.184105] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.184224] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.184295] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.184485] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.184578] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.184629] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.184773] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.184849] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.185021] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.185120] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.185171] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.185293] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.185367] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.185434] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b95bc2dc-a214-45b1-8103-2bccad318c7b is going to be created. [ 798.213578] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.213578] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.213753] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.213856] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.213951] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.214163] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.214276] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.214510] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.214510] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.214599] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.214643] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e399462-679e-43d6-8b03-2876938fc726 is going to be updated. [ 798.249591] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.249811] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.249885] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.250252] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.250394] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.263963] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e399462-679e-43d6-8b03-2876938fc726 in Status: IN_PROGRESS for 2s [ 798.269677] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.269903] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.269993] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.271069] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.271069] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.280313] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b95bc2dc-a214-45b1-8103-2bccad318c7b in Status: IN_PROGRESS for 2s [ 798.476710] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e9d6be64-6e54-486c-a813-4a74669ae10e [ 798.476945] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.477106] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.477182] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.477454] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.477549] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.477659] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e9d6be64-6e54-486c-a813-4a74669ae10e already deleted. [ 798.477745] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9d6be64-6e54-486c-a813-4a74669ae10e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.479504] env[68328]: INFO networking_nsxv3.common.synchronization [req-5176bd9b-70fd-4c14-b74a-aa140269c713 req-644093cb-da38-47d0-9df8-0fad4e2c8c02 service nova] Enqueued Resource ID: f0811b65-cde4-4246-a2e0-5bbd90921f5b with Priority: HIGHEST for action security_group_rules [ 798.479749] env[68328]: INFO networking_nsxv3.common.synchronization [req-5176bd9b-70fd-4c14-b74a-aa140269c713 req-644093cb-da38-47d0-9df8-0fad4e2c8c02 service nova] Enqueued Resource ID: f0811b65-cde4-4246-a2e0-5bbd90921f5b with Priority: HIGHEST for action security_group_members [ 798.479928] env[68328]: INFO networking_nsxv3.common.synchronization [req-5176bd9b-70fd-4c14-b74a-aa140269c713 req-644093cb-da38-47d0-9df8-0fad4e2c8c02 service nova] Enqueued Resource ID: d37081bf-aeeb-4982-893d-4f85b7150d03 with Priority: HIGHEST for action port [ 798.482927] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0811b65-cde4-4246-a2e0-5bbd90921f5b with Priority: HIGHEST for action security_group_rules [ 798.483087] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0811b65-cde4-4246-a2e0-5bbd90921f5b with Priority: HIGHEST for action security_group_members [ 798.483212] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d37081bf-aeeb-4982-893d-4f85b7150d03 with Priority: HIGHEST for action port [ 798.483867] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f0811b65-cde4-4246-a2e0-5bbd90921f5b taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.484028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f0811b65-cde4-4246-a2e0-5bbd90921f5b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.484227] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f0811b65-cde4-4246-a2e0-5bbd90921f5b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.484377] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f0811b65-cde4-4246-a2e0-5bbd90921f5b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.484468] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f0811b65-cde4-4246-a2e0-5bbd90921f5b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.488018] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0811b65-cde4-4246-a2e0-5bbd90921f5b taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.488018] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0811b65-cde4-4246-a2e0-5bbd90921f5b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.488018] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0811b65-cde4-4246-a2e0-5bbd90921f5b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.488018] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0811b65-cde4-4246-a2e0-5bbd90921f5b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.488018] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.488018] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.488018] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.488018] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.488018] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.488018] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0811b65-cde4-4246-a2e0-5bbd90921f5b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.488414] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-d37081bf-aeeb-4982-893d-4f85b7150d03 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.488825] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d37081bf-aeeb-4982-893d-4f85b7150d03" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.488825] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d37081bf-aeeb-4982-893d-4f85b7150d03" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.488825] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d37081bf-aeeb-4982-893d-4f85b7150d03" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.489034] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d37081bf-aeeb-4982-893d-4f85b7150d03',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.993609] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0811b65-cde4-4246-a2e0-5bbd90921f5b taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.993609] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0811b65-cde4-4246-a2e0-5bbd90921f5b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.993609] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f0811b65-cde4-4246-a2e0-5bbd90921f5b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.995527] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d37081bf-aeeb-4982-893d-4f85b7150d03 with status ACTIVE [ 798.995730] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.995853] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.995928] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.996220] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.996341] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.996526] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.996625] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.996686] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.996841] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.996921] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.997106] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.997197] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.997255] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.997393] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.997467] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.997549] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d37081bf-aeeb-4982-893d-4f85b7150d03 is going to be updated. [ 799.017344] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.017485] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.017548] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.017987] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.022027] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.022027] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d37081bf-aeeb-4982-893d-4f85b7150d03" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.499028] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f0811b65-cde4-4246-a2e0-5bbd90921f5b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.557050] env[68328]: INFO networking_nsxv3.common.synchronization [None req-25a535cd-2f6d-46d7-a01a-2806f4754267 None None] Enqueued Resource ID: 35623396-35e8-4081-973a-edc697d5707d with Priority: HIGHEST for action port [ 799.557917] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35623396-35e8-4081-973a-edc697d5707d with Priority: HIGHEST for action port [ 799.559261] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-35623396-35e8-4081-973a-edc697d5707d taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.559345] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-35623396-35e8-4081-973a-edc697d5707d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.559345] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-35623396-35e8-4081-973a-edc697d5707d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.560057] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-35623396-35e8-4081-973a-edc697d5707d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.560057] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35623396-35e8-4081-973a-edc697d5707d',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.873463] env[68328]: INFO networking_nsxv3.common.synchronization [req-26f6bba6-fed9-4814-948c-c3b3fb96bc4a req-6c06115d-2024-43ae-92db-bc9d22f6c724 tempest-ServerAddressesNegativeTestJSON-1146270474 tempest-ServerAddressesNegativeTestJSON-1146270474-project-member] Enqueued Resource ID: 02ce0770-2d9f-451b-8bc9-6982e5dbf513 with Priority: HIGHEST for action security_group_members [ 799.874055] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02ce0770-2d9f-451b-8bc9-6982e5dbf513 with Priority: HIGHEST for action security_group_members [ 799.874371] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-02ce0770-2d9f-451b-8bc9-6982e5dbf513 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.874491] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02ce0770-2d9f-451b-8bc9-6982e5dbf513" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.874559] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02ce0770-2d9f-451b-8bc9-6982e5dbf513" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.874808] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02ce0770-2d9f-451b-8bc9-6982e5dbf513" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.874965] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.875164] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.875229] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.875388] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.875597] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.875706] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02ce0770-2d9f-451b-8bc9-6982e5dbf513',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.998685] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.998685] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.998685] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.998685] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.999364] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.999364] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0811b65-cde4-4246-a2e0-5bbd90921f5b is going to be created. [ 800.029984] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.030155] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.030237] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.030861] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.030861] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.039419] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0811b65-cde4-4246-a2e0-5bbd90921f5b in Status: UNINITIALIZED for 2s [ 800.062892] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 35623396-35e8-4081-973a-edc697d5707d [ 800.063356] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.063356] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.063356] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.063531] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.063617] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.063705] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:35623396-35e8-4081-973a-edc697d5707d already deleted. [ 800.063781] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-35623396-35e8-4081-973a-edc697d5707d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.153226] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 in Status: SUCCESS [ 800.156167] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.156167] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.156167] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.156167] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.156167] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.156167] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.156167] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.156167] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.156167] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.156167] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('55f209f1-d8fe-4d5e-a886-797753b1b3c1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.232774] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-262 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.232996] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-262" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.233170] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-262" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.233732] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-262" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.233808] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.233913] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.234057] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.234302] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.234451] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.234696] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 800.234808] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 800.234921] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 800.235043] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 800.235160] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 800.235264] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 800.235413] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 800.253697] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 800.255753] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 800.255753] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 800.255753] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-262" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.255753] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-76bec14d-2297-417e-a433-3927b77cf040 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.255753] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-76bec14d-2297-417e-a433-3927b77cf040" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.255753] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-76bec14d-2297-417e-a433-3927b77cf040" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.255753] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-76bec14d-2297-417e-a433-3927b77cf040" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.255753] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76bec14d-2297-417e-a433-3927b77cf040',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.272390] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e399462-679e-43d6-8b03-2876938fc726 in Status: SUCCESS [ 800.272572] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e399462-679e-43d6-8b03-2876938fc726 deletion is rescheduled due to dependency. [ 800.272779] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.291986] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b95bc2dc-a214-45b1-8103-2bccad318c7b in Status: SUCCESS [ 800.292222] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b95bc2dc-a214-45b1-8103-2bccad318c7b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.379017] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.379357] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.379514] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.379984] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.380182] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.380612] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.380865] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.380983] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.381318] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.381472] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.381672] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02ce0770-2d9f-451b-8bc9-6982e5dbf513 already deleted. [ 800.381772] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02ce0770-2d9f-451b-8bc9-6982e5dbf513" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.659834] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-55f209f1-d8fe-4d5e-a886-797753b1b3c1 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.660043] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.660130] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.660395] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.660693] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.660824] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.660896] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.661147] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.661323] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.661402] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.661584] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-55f209f1-d8fe-4d5e-a886-797753b1b3c1 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.661699] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.661755] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.661887] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.662058] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.662167] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.662230] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.662388] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.662468] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.662561] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.662652] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('55f209f1-d8fe-4d5e-a886-797753b1b3c1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.761437] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.761717] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.761888] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.762269] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.762462] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.762705] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 76bec14d-2297-417e-a433-3927b77cf040 not found, creating... [ 800.763034] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.763250] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.763406] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.763716] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.763868] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.764287] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.764567] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.764694] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.764951] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.765141] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.765294] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 76bec14d-2297-417e-a433-3927b77cf040 is going to be created. [ 800.784306] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.784569] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.784720] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.785093] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.785366] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.785645] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-76bec14d-2297-417e-a433-3927b77cf040" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.165771] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 55f209f1-d8fe-4d5e-a886-797753b1b3c1: rpc.has_security_group_logging(os_id): False [ 801.182951] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.183290] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.183438] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.183779] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.183946] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.184280] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.184454] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.184572] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.184857] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.184990] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.185339] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.185441] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.185562] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.186187] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.186187] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.186299] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.186434] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.186553] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.186752] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.187373] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.187373] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 is going to be created. [ 801.255358] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.255563] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.255563] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.255784] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.255960] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.266109] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 in Status: IN_PROGRESS for 2s [ 801.531201] env[68328]: INFO networking_nsxv3.common.synchronization [req-26f6bba6-fed9-4814-948c-c3b3fb96bc4a req-b729f1c2-4610-41db-8430-924444a36483 service nova] Enqueued Resource ID: 02ce0770-2d9f-451b-8bc9-6982e5dbf513 with Priority: HIGHEST for action security_group_rules [ 801.531201] env[68328]: INFO networking_nsxv3.common.synchronization [req-26f6bba6-fed9-4814-948c-c3b3fb96bc4a req-b729f1c2-4610-41db-8430-924444a36483 service nova] Enqueued Resource ID: 02ce0770-2d9f-451b-8bc9-6982e5dbf513 with Priority: HIGHEST for action security_group_members [ 801.531201] env[68328]: INFO networking_nsxv3.common.synchronization [req-26f6bba6-fed9-4814-948c-c3b3fb96bc4a req-b729f1c2-4610-41db-8430-924444a36483 service nova] Enqueued Resource ID: 76bec14d-2297-417e-a433-3927b77cf040 with Priority: HIGHEST for action port [ 801.531201] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02ce0770-2d9f-451b-8bc9-6982e5dbf513 with Priority: HIGHEST for action security_group_rules [ 801.531485] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02ce0770-2d9f-451b-8bc9-6982e5dbf513 with Priority: HIGHEST for action security_group_members [ 801.531682] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76bec14d-2297-417e-a433-3927b77cf040 with Priority: HIGHEST for action port [ 801.532067] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-02ce0770-2d9f-451b-8bc9-6982e5dbf513 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.532326] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-02ce0770-2d9f-451b-8bc9-6982e5dbf513" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.532482] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-02ce0770-2d9f-451b-8bc9-6982e5dbf513" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.532816] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-02ce0770-2d9f-451b-8bc9-6982e5dbf513" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.533110] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('02ce0770-2d9f-451b-8bc9-6982e5dbf513',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.535025] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-02ce0770-2d9f-451b-8bc9-6982e5dbf513 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.535025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02ce0770-2d9f-451b-8bc9-6982e5dbf513" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.535025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02ce0770-2d9f-451b-8bc9-6982e5dbf513" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.536137] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02ce0770-2d9f-451b-8bc9-6982e5dbf513" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.536411] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.536588] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.536695] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.536936] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.537089] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.537269] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02ce0770-2d9f-451b-8bc9-6982e5dbf513',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.538491] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-76bec14d-2297-417e-a433-3927b77cf040 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.539013] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-76bec14d-2297-417e-a433-3927b77cf040" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.539013] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-76bec14d-2297-417e-a433-3927b77cf040" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.539266] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-76bec14d-2297-417e-a433-3927b77cf040" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.539378] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76bec14d-2297-417e-a433-3927b77cf040',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.043713] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-02ce0770-2d9f-451b-8bc9-6982e5dbf513 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.043713] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02ce0770-2d9f-451b-8bc9-6982e5dbf513" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.043713] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('02ce0770-2d9f-451b-8bc9-6982e5dbf513',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.043713] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 76bec14d-2297-417e-a433-3927b77cf040 with status ACTIVE [ 802.043713] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.043713] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.043713] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.043713] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.044055] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.044055] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.044170] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.044209] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.044402] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.044497] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.044678] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.044840] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.044840] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.045138] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.045138] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.045208] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 76bec14d-2297-417e-a433-3927b77cf040 is going to be updated. [ 802.054967] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0811b65-cde4-4246-a2e0-5bbd90921f5b in Status: SUCCESS [ 802.054967] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0811b65-cde4-4246-a2e0-5bbd90921f5b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.054967] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0811b65-cde4-4246-a2e0-5bbd90921f5b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.054967] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0811b65-cde4-4246-a2e0-5bbd90921f5b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.054967] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.054967] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.054967] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.054967] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.054967] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.054967] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0811b65-cde4-4246-a2e0-5bbd90921f5b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.054967] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f0811b65-cde4-4246-a2e0-5bbd90921f5b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.065712] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.065712] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.065712] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.065712] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.065712] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.065712] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-76bec14d-2297-417e-a433-3927b77cf040" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.415542] env[68328]: INFO networking_nsxv3.common.synchronization [req-93fe6596-f95a-4838-a2d4-ecaf86afd316 req-be3c157c-161f-4ae5-97cd-587df386ae8b tempest-ServersTestMultiNic-360170984 tempest-ServersTestMultiNic-360170984-project-member] Enqueued Resource ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc with Priority: HIGHEST for action security_group_members [ 802.416535] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc with Priority: HIGHEST for action security_group_members [ 802.416682] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.416765] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.416852] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.416984] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.417260] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.417399] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.417482] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.417661] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.417751] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.417845] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba6f8661-b38c-4d97-a1c5-4a0e33e341bc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.547726] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('02ce0770-2d9f-451b-8bc9-6982e5dbf513',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.557973] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0811b65-cde4-4246-a2e0-5bbd90921f5b taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.558272] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0811b65-cde4-4246-a2e0-5bbd90921f5b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.558394] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0811b65-cde4-4246-a2e0-5bbd90921f5b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.558701] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0811b65-cde4-4246-a2e0-5bbd90921f5b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.559867] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.559867] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.559867] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.559867] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.559867] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.559867] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0811b65-cde4-4246-a2e0-5bbd90921f5b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.559867] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0811b65-cde4-4246-a2e0-5bbd90921f5b taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.560220] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0811b65-cde4-4246-a2e0-5bbd90921f5b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.560220] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0811b65-cde4-4246-a2e0-5bbd90921f5b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.560434] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0811b65-cde4-4246-a2e0-5bbd90921f5b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.560621] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.560783] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.560942] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.561155] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.561635] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.561807] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0811b65-cde4-4246-a2e0-5bbd90921f5b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.561971] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f0811b65-cde4-4246-a2e0-5bbd90921f5b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.872164] env[68328]: INFO networking_nsxv3.common.synchronization [req-93fe6596-f95a-4838-a2d4-ecaf86afd316 req-d8505770-4223-48ca-ba1a-f1659d9f2d75 tempest-ServersTestMultiNic-360170984 tempest-ServersTestMultiNic-360170984-project-member] Enqueued Resource ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc with Priority: HIGHEST for action security_group_members [ 802.872583] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc with Priority: HIGHEST for action security_group_members [ 802.875703] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.875851] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.924165] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.924400] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.924573] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.924699] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.924801] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.925031] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.925203] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.925203] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.925422] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.925491] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.925596] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc is going to be updated. [ 802.950290] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.950447] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.950523] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.950770] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.950946] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.959520] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc in Status: IN_PROGRESS for 2s [ 803.055547] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.057025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.057025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.057025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.057025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.057025] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02ce0770-2d9f-451b-8bc9-6982e5dbf513 is going to be created. [ 803.068033] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f0811b65-cde4-4246-a2e0-5bbd90921f5b: rpc.has_security_group_logging(os_id): False [ 803.079281] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.079281] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.079281] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.080018] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.080018] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.082036] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.082036] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.082036] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.082258] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.082294] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.082534] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.082704] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.082876] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.082966] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.083039] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.083286] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.083433] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.083503] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.083693] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.083804] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.084055] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.084170] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.084257] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.084436] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.084896] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.084896] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0811b65-cde4-4246-a2e0-5bbd90921f5b is going to be created. [ 803.095243] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02ce0770-2d9f-451b-8bc9-6982e5dbf513 in Status: UNINITIALIZED for 2s [ 803.139716] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.141311] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.141311] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.141311] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.141311] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.156501] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0811b65-cde4-4246-a2e0-5bbd90921f5b in Status: IN_PROGRESS for 2s [ 803.276444] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 in Status: SUCCESS [ 803.276679] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.550169] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-163 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.550528] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-163" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.550528] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-163" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.550829] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-163" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.553632] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.553846] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.553969] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.554238] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.554385] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.554599] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 803.554712] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 803.554822] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 803.554932] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 803.555047] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 803.555156] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 803.555288] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 803.574379] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 803.574569] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 803.574704] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 803.574892] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-163" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.575252] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-ab992309-8a64-4361-ad52-536b2cfa0d26 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.575417] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-ab992309-8a64-4361-ad52-536b2cfa0d26" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.575539] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-ab992309-8a64-4361-ad52-536b2cfa0d26" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.575880] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-ab992309-8a64-4361-ad52-536b2cfa0d26" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.576024] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab992309-8a64-4361-ad52-536b2cfa0d26',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.082279] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.082279] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.082279] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.082279] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.082279] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.082279] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port ab992309-8a64-4361-ad52-536b2cfa0d26 not found, creating... [ 804.082279] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.082279] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.082279] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.082279] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.082279] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.082792] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.082792] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.082792] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.082792] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.082941] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.082998] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: ab992309-8a64-4361-ad52-536b2cfa0d26 is going to be created. [ 804.101189] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.101189] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.101309] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.101560] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.101792] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.102016] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-ab992309-8a64-4361-ad52-536b2cfa0d26" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.285428] env[68328]: INFO networking_nsxv3.common.synchronization [req-f152e448-b735-4a3e-8502-970c6ebd16ce req-3ec36fc3-4542-409d-8fda-24d90fb7799d tempest-AttachInterfacesV270Test-309391658 tempest-AttachInterfacesV270Test-309391658-project-member] Enqueued Resource ID: b95bc2dc-a214-45b1-8103-2bccad318c7b with Priority: HIGHEST for action security_group_members [ 804.285969] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b95bc2dc-a214-45b1-8103-2bccad318c7b with Priority: HIGHEST for action security_group_members [ 804.286405] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b95bc2dc-a214-45b1-8103-2bccad318c7b taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.286405] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b95bc2dc-a214-45b1-8103-2bccad318c7b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.286590] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b95bc2dc-a214-45b1-8103-2bccad318c7b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.286696] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b95bc2dc-a214-45b1-8103-2bccad318c7b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.286844] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.286937] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.286990] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.287632] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.287720] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.287825] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b95bc2dc-a214-45b1-8103-2bccad318c7b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.793550] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.793848] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.793848] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.794121] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.794224] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.794559] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.794559] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.794878] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.794878] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.795060] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.795118] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b95bc2dc-a214-45b1-8103-2bccad318c7b is going to be updated. [ 804.827283] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.827461] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.827522] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.827721] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.827917] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.835439] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b95bc2dc-a214-45b1-8103-2bccad318c7b in Status: IN_PROGRESS for 2s [ 804.852283] env[68328]: INFO networking_nsxv3.common.synchronization [req-93fe6596-f95a-4838-a2d4-ecaf86afd316 req-874145a3-a34f-4181-b89c-05ebe197c736 service nova] Enqueued Resource ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc with Priority: HIGHEST for action security_group_rules [ 804.852458] env[68328]: INFO networking_nsxv3.common.synchronization [req-93fe6596-f95a-4838-a2d4-ecaf86afd316 req-874145a3-a34f-4181-b89c-05ebe197c736 service nova] Enqueued Resource ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc with Priority: HIGHEST for action security_group_members [ 804.852617] env[68328]: INFO networking_nsxv3.common.synchronization [req-93fe6596-f95a-4838-a2d4-ecaf86afd316 req-874145a3-a34f-4181-b89c-05ebe197c736 service nova] Enqueued Resource ID: ab992309-8a64-4361-ad52-536b2cfa0d26 with Priority: HIGHEST for action port [ 804.852859] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc with Priority: HIGHEST for action security_group_rules [ 804.852989] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc with Priority: HIGHEST for action security_group_members [ 804.853102] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab992309-8a64-4361-ad52-536b2cfa0d26 with Priority: HIGHEST for action port [ 804.853690] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.853861] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.853914] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.854524] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.854524] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba6f8661-b38c-4d97-a1c5-4a0e33e341bc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.855275] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.855437] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.855554] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab992309-8a64-4361-ad52-536b2cfa0d26 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.855653] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab992309-8a64-4361-ad52-536b2cfa0d26" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.855712] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab992309-8a64-4361-ad52-536b2cfa0d26" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.855880] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab992309-8a64-4361-ad52-536b2cfa0d26" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.855953] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab992309-8a64-4361-ad52-536b2cfa0d26',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.968368] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc in Status: SUCCESS [ 804.968548] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc deletion is rescheduled due to dependency. [ 804.968660] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.969242] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.969540] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.969877] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.969943] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.969995] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.970173] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.970254] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.970365] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba6f8661-b38c-4d97-a1c5-4a0e33e341bc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.105955] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02ce0770-2d9f-451b-8bc9-6982e5dbf513 in Status: SUCCESS [ 805.105955] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02ce0770-2d9f-451b-8bc9-6982e5dbf513" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.105955] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02ce0770-2d9f-451b-8bc9-6982e5dbf513" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.105955] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02ce0770-2d9f-451b-8bc9-6982e5dbf513" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.106581] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.106892] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.107231] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.107947] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.107947] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.108504] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02ce0770-2d9f-451b-8bc9-6982e5dbf513" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.108720] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('02ce0770-2d9f-451b-8bc9-6982e5dbf513',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.168412] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0811b65-cde4-4246-a2e0-5bbd90921f5b in Status: SUCCESS [ 805.168693] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f0811b65-cde4-4246-a2e0-5bbd90921f5b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.178715] env[68328]: INFO networking_nsxv3.common.synchronization [req-7a589fae-8f3a-44f5-a0ce-ebfec4968d1a req-33f2cc15-e7b8-4c0f-b1da-d6160cd60472 tempest-SecurityGroupsTestJSON-429138018 tempest-SecurityGroupsTestJSON-429138018-project-member] Enqueued Resource ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 with Priority: HIGHEST for action security_group_members [ 805.178715] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 with Priority: HIGHEST for action security_group_members [ 805.178715] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-870ec36b-ba1d-4422-a26d-1328f51f79e4 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.178715] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.178715] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.178715] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.178715] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.178715] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.178715] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.179326] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.179406] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.179621] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.358665] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.358820] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.359018] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ab992309-8a64-4361-ad52-536b2cfa0d26 with status ACTIVE [ 805.359195] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.359322] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.359388] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.360188] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.360416] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.361345] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.361345] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.361345] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.361345] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.361607] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.364155] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.364155] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.364155] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.364155] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.364155] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.364155] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ab992309-8a64-4361-ad52-536b2cfa0d26 is going to be updated. [ 805.388741] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.388957] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.389046] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.389823] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.389990] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.390178] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab992309-8a64-4361-ad52-536b2cfa0d26" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.475642] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ba6f8661-b38c-4d97-a1c5-4a0e33e341bc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.611629] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-02ce0770-2d9f-451b-8bc9-6982e5dbf513 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.612664] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02ce0770-2d9f-451b-8bc9-6982e5dbf513" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.612664] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02ce0770-2d9f-451b-8bc9-6982e5dbf513" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.612664] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02ce0770-2d9f-451b-8bc9-6982e5dbf513" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.612664] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.612664] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.612664] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.612946] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.612946] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.612946] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02ce0770-2d9f-451b-8bc9-6982e5dbf513" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.613094] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-02ce0770-2d9f-451b-8bc9-6982e5dbf513 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.613201] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02ce0770-2d9f-451b-8bc9-6982e5dbf513" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.613263] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02ce0770-2d9f-451b-8bc9-6982e5dbf513" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.613407] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02ce0770-2d9f-451b-8bc9-6982e5dbf513" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.614347] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.614913] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.615015] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.615430] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.615430] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.615430] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02ce0770-2d9f-451b-8bc9-6982e5dbf513" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.615541] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('02ce0770-2d9f-451b-8bc9-6982e5dbf513',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.619782] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-852 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.619965] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-852" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.619965] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-852" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.620341] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-852" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.622159] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.622159] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.622159] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.622159] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.622159] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.622159] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 805.622159] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 805.622159] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 805.622159] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 805.622159] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 805.622159] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 805.622159] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 805.644752] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 805.644954] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 805.645108] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 805.645298] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-852" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.646109] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-bd68cdf0-4228-4df5-9676-402abe5b5b2f taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.646109] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-bd68cdf0-4228-4df5-9676-402abe5b5b2f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.646109] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-bd68cdf0-4228-4df5-9676-402abe5b5b2f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.646705] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-bd68cdf0-4228-4df5-9676-402abe5b5b2f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.646705] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd68cdf0-4228-4df5-9676-402abe5b5b2f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.685803] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.779484] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-649 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.779807] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-649" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.779972] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-649" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.780465] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-649" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.785115] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.785115] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.785115] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.785115] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.785115] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.785115] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 805.785115] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 805.785115] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 805.785115] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 805.785115] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 805.785115] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 805.785115] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 805.806400] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 805.806400] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 805.806400] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 805.807536] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-649" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.808360] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-992c115a-70bc-408d-994f-3a4050780718 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.810463] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-992c115a-70bc-408d-994f-3a4050780718" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.810463] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-992c115a-70bc-408d-994f-3a4050780718" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.810463] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-992c115a-70bc-408d-994f-3a4050780718" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.810463] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('992c115a-70bc-408d-994f-3a4050780718',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.978721] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ba6f8661-b38c-4d97-a1c5-4a0e33e341bc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.128890] env[68328]: INFO networking_nsxv3.common.synchronization [None req-0c94791d-e923-437c-8006-817aafabe36d None None] Enqueued Resource ID: fc90a817-1990-4436-9c65-62f19b0014b2 with Priority: HIGHEST for action port [ 806.129292] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 02ce0770-2d9f-451b-8bc9-6982e5dbf513: rpc.has_security_group_logging(os_id): False [ 806.131282] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc90a817-1990-4436-9c65-62f19b0014b2 with Priority: HIGHEST for action port [ 806.131663] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc90a817-1990-4436-9c65-62f19b0014b2 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.131837] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc90a817-1990-4436-9c65-62f19b0014b2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.131901] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc90a817-1990-4436-9c65-62f19b0014b2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.132399] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc90a817-1990-4436-9c65-62f19b0014b2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.132531] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc90a817-1990-4436-9c65-62f19b0014b2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.149075] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.149328] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.149446] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.149761] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.149948] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.150129] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port bd68cdf0-4228-4df5-9676-402abe5b5b2f not found, creating... [ 806.150419] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.150556] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.150671] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.150900] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.151052] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.151331] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.151479] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.151805] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.151805] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.151917] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.152224] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: bd68cdf0-4228-4df5-9676-402abe5b5b2f is going to be created. [ 806.154030] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.154581] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.154696] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.154906] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.155037] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.155243] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.155375] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.155467] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.155645] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.155766] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.156010] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.156148] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.156226] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.156395] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.156499] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.156727] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.156850] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.156937] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.157116] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.157418] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.157418] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 02ce0770-2d9f-451b-8bc9-6982e5dbf513 is going to be created. [ 806.184652] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.185016] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.185198] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.185511] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.185931] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.186065] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-bd68cdf0-4228-4df5-9676-402abe5b5b2f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.187138] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.225849] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.226013] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.226086] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.226300] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.226468] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.241207] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02ce0770-2d9f-451b-8bc9-6982e5dbf513 in Status: IN_PROGRESS for 2s [ 806.315177] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.315177] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.315177] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.315177] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.315177] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.315177] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 992c115a-70bc-408d-994f-3a4050780718 not found, creating... [ 806.315177] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.315177] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.315177] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.315177] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.315559] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.315738] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.315940] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.317060] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.317060] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.317060] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.317265] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 992c115a-70bc-408d-994f-3a4050780718 is going to be created. [ 806.346910] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.347192] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.347316] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.347587] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.347837] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.348727] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-992c115a-70bc-408d-994f-3a4050780718" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.480823] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.481062] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.481157] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.481374] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.481470] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.482489] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc is going to be updated. [ 806.531347] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.531508] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.531573] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.531779] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.531970] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.544990] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc in Status: IN_PROGRESS for 2s [ 806.638099] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fc90a817-1990-4436-9c65-62f19b0014b2 [ 806.638395] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.638565] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.638642] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.638869] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.639225] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.639225] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fc90a817-1990-4436-9c65-62f19b0014b2 already deleted. [ 806.639225] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc90a817-1990-4436-9c65-62f19b0014b2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.689961] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.693602] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.693602] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.693602] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.693602] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.693602] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 is going to be updated. [ 806.723606] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.723744] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.723814] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.724097] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.724279] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.734805] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 in Status: IN_PROGRESS for 2s [ 806.845995] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b95bc2dc-a214-45b1-8103-2bccad318c7b in Status: SUCCESS [ 806.846298] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b95bc2dc-a214-45b1-8103-2bccad318c7b deletion is rescheduled due to dependency. [ 806.846298] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b95bc2dc-a214-45b1-8103-2bccad318c7b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.055545] env[68328]: INFO networking_nsxv3.common.synchronization [req-7a589fae-8f3a-44f5-a0ce-ebfec4968d1a req-a2898e90-0b0c-4c32-8b7b-2b05b73c056d service nova] Enqueued Resource ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 with Priority: HIGHEST for action security_group_rules [ 807.055545] env[68328]: INFO networking_nsxv3.common.synchronization [req-7a589fae-8f3a-44f5-a0ce-ebfec4968d1a req-a2898e90-0b0c-4c32-8b7b-2b05b73c056d service nova] Enqueued Resource ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 with Priority: HIGHEST for action security_group_members [ 807.055545] env[68328]: INFO networking_nsxv3.common.synchronization [req-7a589fae-8f3a-44f5-a0ce-ebfec4968d1a req-a2898e90-0b0c-4c32-8b7b-2b05b73c056d service nova] Enqueued Resource ID: bd68cdf0-4228-4df5-9676-402abe5b5b2f with Priority: HIGHEST for action port [ 807.055726] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 with Priority: HIGHEST for action security_group_rules [ 807.055726] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 with Priority: HIGHEST for action security_group_members [ 807.055798] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd68cdf0-4228-4df5-9676-402abe5b5b2f with Priority: HIGHEST for action port [ 807.060021] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-870ec36b-ba1d-4422-a26d-1328f51f79e4 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.060021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.060021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.060021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.060021] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.060021] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-870ec36b-ba1d-4422-a26d-1328f51f79e4 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.060021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.060021] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd68cdf0-4228-4df5-9676-402abe5b5b2f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.060021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd68cdf0-4228-4df5-9676-402abe5b5b2f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.060021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd68cdf0-4228-4df5-9676-402abe5b5b2f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.060021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd68cdf0-4228-4df5-9676-402abe5b5b2f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.060021] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd68cdf0-4228-4df5-9676-402abe5b5b2f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.177041] env[68328]: INFO networking_nsxv3.common.synchronization [req-93fe6596-f95a-4838-a2d4-ecaf86afd316 req-74cebd72-c0fc-4a77-b65c-81c24325715f service nova] Enqueued Resource ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc with Priority: HIGHEST for action security_group_rules [ 807.177303] env[68328]: INFO networking_nsxv3.common.synchronization [req-93fe6596-f95a-4838-a2d4-ecaf86afd316 req-74cebd72-c0fc-4a77-b65c-81c24325715f service nova] Enqueued Resource ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc with Priority: HIGHEST for action security_group_members [ 807.177433] env[68328]: INFO networking_nsxv3.common.synchronization [req-93fe6596-f95a-4838-a2d4-ecaf86afd316 req-74cebd72-c0fc-4a77-b65c-81c24325715f service nova] Enqueued Resource ID: 992c115a-70bc-408d-994f-3a4050780718 with Priority: HIGHEST for action port [ 807.177993] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc with Priority: HIGHEST for action security_group_rules [ 807.178268] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc with Priority: HIGHEST for action security_group_members [ 807.178378] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 992c115a-70bc-408d-994f-3a4050780718 with Priority: HIGHEST for action port [ 807.178655] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.178756] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.178942] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.179068] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.179650] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-992c115a-70bc-408d-994f-3a4050780718 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.179650] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-992c115a-70bc-408d-994f-3a4050780718" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.179650] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-992c115a-70bc-408d-994f-3a4050780718" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.180668] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-992c115a-70bc-408d-994f-3a4050780718" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.180774] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('992c115a-70bc-408d-994f-3a4050780718',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.560330] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-870ec36b-ba1d-4422-a26d-1328f51f79e4 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.560478] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.560654] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bd68cdf0-4228-4df5-9676-402abe5b5b2f with status ACTIVE [ 807.560827] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.560950] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.560991] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.561218] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.561311] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.561479] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.561572] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.561632] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.561780] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.561858] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.562047] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.562167] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.562254] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.562353] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.562456] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.562500] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bd68cdf0-4228-4df5-9676-402abe5b5b2f is going to be updated. [ 807.596375] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.596375] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.596537] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.599198] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.599198] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.599198] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd68cdf0-4228-4df5-9676-402abe5b5b2f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.693028] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 992c115a-70bc-408d-994f-3a4050780718 with status ACTIVE [ 807.693028] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.693028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.693028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.693028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.693028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.693028] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.693028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.693028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.693028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.693028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.693028] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.693028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.693028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.693028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.693028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.693028] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 992c115a-70bc-408d-994f-3a4050780718 is going to be updated. [ 807.713081] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.713837] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.713837] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.713837] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.713837] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.713837] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-992c115a-70bc-408d-994f-3a4050780718" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.254236] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02ce0770-2d9f-451b-8bc9-6982e5dbf513 in Status: SUCCESS [ 808.254549] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-02ce0770-2d9f-451b-8bc9-6982e5dbf513" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.554463] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc in Status: SUCCESS [ 808.554580] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.554743] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.555011] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.555227] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.555349] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.555411] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.555610] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.555681] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.555744] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba6f8661-b38c-4d97-a1c5-4a0e33e341bc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.743199] env[68328]: INFO networking_nsxv3.common.synchronization [None req-0e0dd426-b4ab-46e1-9597-4ea9907e7e46 None None] Enqueued Resource ID: 5a8854aa-5df5-47db-beb0-0ed3fb7f1ae1 with Priority: HIGHEST for action port [ 808.743199] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a8854aa-5df5-47db-beb0-0ed3fb7f1ae1 with Priority: HIGHEST for action port [ 808.743199] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-5a8854aa-5df5-47db-beb0-0ed3fb7f1ae1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.743199] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5a8854aa-5df5-47db-beb0-0ed3fb7f1ae1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.743199] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5a8854aa-5df5-47db-beb0-0ed3fb7f1ae1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.743741] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5a8854aa-5df5-47db-beb0-0ed3fb7f1ae1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.743973] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a8854aa-5df5-47db-beb0-0ed3fb7f1ae1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.746524] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 in Status: SUCCESS [ 808.747155] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.748160] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.748160] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.749025] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.749025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.749025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.749025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.749025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.749337] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.059052] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ba6f8661-b38c-4d97-a1c5-4a0e33e341bc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.247073] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5a8854aa-5df5-47db-beb0-0ed3fb7f1ae1 [ 809.247341] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.247476] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.247588] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.247784] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.248138] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.248138] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5a8854aa-5df5-47db-beb0-0ed3fb7f1ae1 already deleted. [ 809.248251] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5a8854aa-5df5-47db-beb0-0ed3fb7f1ae1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.251678] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.442459] env[68328]: INFO networking_nsxv3.common.synchronization [req-89e79a04-42d9-46b5-ae1f-e290afeb6013 req-5f0c0c06-d9a4-4d97-a2fc-ffee78c2bb3b tempest-MultipleCreateTestJSON-885002055 tempest-MultipleCreateTestJSON-885002055-project-member] Enqueued Resource ID: 96047272-421b-4187-99a6-e18e4a01bfc9 with Priority: HIGHEST for action security_group_members [ 809.443578] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96047272-421b-4187-99a6-e18e4a01bfc9 with Priority: HIGHEST for action security_group_members [ 809.446600] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-96047272-421b-4187-99a6-e18e4a01bfc9 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.446600] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.446600] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.446600] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.446600] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.446600] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.446600] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.446600] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.446600] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.446600] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('96047272-421b-4187-99a6-e18e4a01bfc9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.562021] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ba6f8661-b38c-4d97-a1c5-4a0e33e341bc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.754025] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.881983] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-133 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.881983] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-133" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.881983] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-133" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.881983] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-133" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.882478] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.882684] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.882859] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.883174] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.883367] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.883812] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 809.883957] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 809.884117] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 809.884248] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 809.884399] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 809.884554] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 809.884746] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 809.904377] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 809.904377] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 809.904377] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 809.904377] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-133" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.904700] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-3af465dd-6132-4e13-a37d-e682c8afd0d3 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.905554] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-3af465dd-6132-4e13-a37d-e682c8afd0d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.905554] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-3af465dd-6132-4e13-a37d-e682c8afd0d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.905554] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-3af465dd-6132-4e13-a37d-e682c8afd0d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.905698] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3af465dd-6132-4e13-a37d-e682c8afd0d3',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.951151] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.951151] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.951151] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.951151] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.951151] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.951151] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.951151] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.951151] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.951151] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.951151] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.951151] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96047272-421b-4187-99a6-e18e4a01bfc9 is going to be updated. [ 809.975522] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.975522] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.975522] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.975522] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.975522] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.988957] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96047272-421b-4187-99a6-e18e4a01bfc9 in Status: IN_PROGRESS for 2s [ 810.066782] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.066782] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.066782] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.066782] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.066782] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.066782] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc is going to be updated. [ 810.095633] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.095633] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.095633] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.095633] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.095633] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.102259] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc in Status: IN_PROGRESS for 2s [ 810.257126] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.257676] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.258668] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.258668] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.258668] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.258668] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 is going to be updated. [ 810.287471] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.287471] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.287471] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.288633] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.288633] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.295583] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 in Status: IN_PROGRESS for 2s [ 810.409103] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.409251] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.409339] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.409584] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.409734] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.409941] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 3af465dd-6132-4e13-a37d-e682c8afd0d3 not found, creating... [ 810.410223] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.410382] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.410498] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.410711] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.410848] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.411184] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.411343] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.411458] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.411662] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.411796] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.411975] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 3af465dd-6132-4e13-a37d-e682c8afd0d3 is going to be created. [ 810.432037] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.432037] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.432037] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.432037] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.432359] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.432595] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-3af465dd-6132-4e13-a37d-e682c8afd0d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.328098] env[68328]: INFO networking_nsxv3.common.synchronization [req-89e79a04-42d9-46b5-ae1f-e290afeb6013 req-bad0205d-e990-43c0-9eae-4beb643ff556 service nova] Enqueued Resource ID: 96047272-421b-4187-99a6-e18e4a01bfc9 with Priority: HIGHEST for action security_group_rules [ 811.328354] env[68328]: INFO networking_nsxv3.common.synchronization [req-89e79a04-42d9-46b5-ae1f-e290afeb6013 req-bad0205d-e990-43c0-9eae-4beb643ff556 service nova] Enqueued Resource ID: 96047272-421b-4187-99a6-e18e4a01bfc9 with Priority: HIGHEST for action security_group_members [ 811.328389] env[68328]: INFO networking_nsxv3.common.synchronization [req-89e79a04-42d9-46b5-ae1f-e290afeb6013 req-bad0205d-e990-43c0-9eae-4beb643ff556 service nova] Enqueued Resource ID: 3af465dd-6132-4e13-a37d-e682c8afd0d3 with Priority: HIGHEST for action port [ 811.328652] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96047272-421b-4187-99a6-e18e4a01bfc9 with Priority: HIGHEST for action security_group_rules [ 811.328783] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96047272-421b-4187-99a6-e18e4a01bfc9 with Priority: HIGHEST for action security_group_members [ 811.328878] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3af465dd-6132-4e13-a37d-e682c8afd0d3 with Priority: HIGHEST for action port [ 811.330467] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-96047272-421b-4187-99a6-e18e4a01bfc9 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.330467] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.330467] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.330467] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.330467] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('96047272-421b-4187-99a6-e18e4a01bfc9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.332223] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-96047272-421b-4187-99a6-e18e4a01bfc9 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.332305] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.332543] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-3af465dd-6132-4e13-a37d-e682c8afd0d3 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.332653] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3af465dd-6132-4e13-a37d-e682c8afd0d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.332741] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3af465dd-6132-4e13-a37d-e682c8afd0d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.333388] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3af465dd-6132-4e13-a37d-e682c8afd0d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.333388] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3af465dd-6132-4e13-a37d-e682c8afd0d3',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.835915] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-96047272-421b-4187-99a6-e18e4a01bfc9 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.841890] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.841890] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3af465dd-6132-4e13-a37d-e682c8afd0d3 with status ACTIVE [ 811.841890] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.841890] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.841890] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.841890] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.841890] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.841890] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.841890] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.841890] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.841890] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.841890] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.841890] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.841890] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.841890] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.841890] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.841890] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.842488] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3af465dd-6132-4e13-a37d-e682c8afd0d3 is going to be updated. [ 811.883083] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.883083] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.883083] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.883083] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.883083] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.883083] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3af465dd-6132-4e13-a37d-e682c8afd0d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.002948] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96047272-421b-4187-99a6-e18e4a01bfc9 in Status: SUCCESS [ 812.002948] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96047272-421b-4187-99a6-e18e4a01bfc9 deletion is rescheduled due to dependency. [ 812.002948] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.002948] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.002948] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.003275] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.003275] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.003365] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.003457] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.003537] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.003629] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('96047272-421b-4187-99a6-e18e4a01bfc9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.115024] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc in Status: IN_PROGRESS for 4s [ 812.308172] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 in Status: SUCCESS [ 812.308172] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.308172] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.308452] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.309146] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.309146] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.309146] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.309330] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.309511] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.310533] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.310665] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.506043] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('96047272-421b-4187-99a6-e18e4a01bfc9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.814928] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-870ec36b-ba1d-4422-a26d-1328f51f79e4 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.814928] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.814928] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.814928] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.814928] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.814928] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.814928] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.814928] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.814928] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.814928] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.814928] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-870ec36b-ba1d-4422-a26d-1328f51f79e4 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.814928] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.814928] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.814928] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.814928] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.814928] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.815667] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.815667] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.815667] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.815667] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.815667] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.008385] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('96047272-421b-4187-99a6-e18e4a01bfc9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.316808] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 870ec36b-ba1d-4422-a26d-1328f51f79e4: rpc.has_security_group_logging(os_id): False [ 813.334876] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.335717] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.335717] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.335717] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.335913] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.336143] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.336267] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.336343] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.337033] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.337033] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.337033] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.337494] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.337494] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.337494] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.337494] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.337703] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.337836] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.337884] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.338176] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.338176] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.338595] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 is going to be updated. [ 813.396141] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.396360] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.396400] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.396608] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.396783] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.408036] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 in Status: IN_PROGRESS for 2s [ 813.511903] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.512248] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.512452] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.512737] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.512926] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.513415] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96047272-421b-4187-99a6-e18e4a01bfc9 is going to be updated. [ 813.542252] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.542530] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.542530] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.542661] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.542806] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.551929] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96047272-421b-4187-99a6-e18e4a01bfc9 in Status: IN_PROGRESS for 2s [ 814.124033] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc in Status: SUCCESS [ 814.124033] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.124033] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.124033] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.124033] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.124033] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.124033] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.124033] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.124033] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.124033] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.124033] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ba6f8661-b38c-4d97-a1c5-4a0e33e341bc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.124757] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.124757] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.124757] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.124757] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.124888] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.124916] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.125034] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.125132] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba6f8661-b38c-4d97-a1c5-4a0e33e341bc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.254326] env[68328]: INFO networking_nsxv3.common.synchronization [req-89e79a04-42d9-46b5-ae1f-e290afeb6013 req-10f3844f-3aee-404c-a529-d021f9f3ce64 tempest-MultipleCreateTestJSON-885002055 tempest-MultipleCreateTestJSON-885002055-project-member] Enqueued Resource ID: 96047272-421b-4187-99a6-e18e4a01bfc9 with Priority: HIGHEST for action security_group_members [ 814.254873] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96047272-421b-4187-99a6-e18e4a01bfc9 with Priority: HIGHEST for action security_group_members [ 814.255193] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-96047272-421b-4187-99a6-e18e4a01bfc9 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.255305] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.629019] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.629019] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.629019] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ba6f8661-b38c-4d97-a1c5-4a0e33e341bc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.914838] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-133 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.915170] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-133" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.915170] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-133" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.915438] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-133" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.915708] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.915871] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.915986] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.916280] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.916378] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.916527] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 814.916661] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 814.916799] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 814.916849] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 814.916964] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 814.917112] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 814.917210] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 814.939223] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 814.939223] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 814.939223] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 814.939223] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-133" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.939223] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-8a91ae12-1762-481c-9e92-2521149496f5 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.939223] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-8a91ae12-1762-481c-9e92-2521149496f5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.939223] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-8a91ae12-1762-481c-9e92-2521149496f5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.939223] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-8a91ae12-1762-481c-9e92-2521149496f5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.939223] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a91ae12-1762-481c-9e92-2521149496f5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.134428] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ba6f8661-b38c-4d97-a1c5-4a0e33e341bc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.225660] env[68328]: INFO networking_nsxv3.common.synchronization [req-5c643dd4-ccb9-4a88-ac1c-6a0f107446f9 req-cf764c82-67f7-4a74-a1d6-0aa8cc202453 tempest-ServerAddressesNegativeTestJSON-1146270474 tempest-ServerAddressesNegativeTestJSON-1146270474-project-member] Enqueued Resource ID: 02ce0770-2d9f-451b-8bc9-6982e5dbf513 with Priority: HIGHEST for action security_group_members [ 815.227810] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02ce0770-2d9f-451b-8bc9-6982e5dbf513 with Priority: HIGHEST for action security_group_members [ 815.228389] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-02ce0770-2d9f-451b-8bc9-6982e5dbf513 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.230103] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02ce0770-2d9f-451b-8bc9-6982e5dbf513" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.230284] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02ce0770-2d9f-451b-8bc9-6982e5dbf513" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.230580] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02ce0770-2d9f-451b-8bc9-6982e5dbf513" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.230839] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.231129] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.231296] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.231562] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.231737] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.231900] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02ce0770-2d9f-451b-8bc9-6982e5dbf513',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.421940] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 in Status: SUCCESS [ 815.421940] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.444683] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.444683] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.444683] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.444683] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.444683] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.444683] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 8a91ae12-1762-481c-9e92-2521149496f5 not found, creating... [ 815.444683] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.444683] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.446625] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.446625] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.446625] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.446625] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.446625] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.446625] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.446625] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.446996] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.446996] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 8a91ae12-1762-481c-9e92-2521149496f5 is going to be created. [ 815.465205] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.465377] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.465440] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.465729] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.466087] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.466506] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-8a91ae12-1762-481c-9e92-2521149496f5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.562047] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96047272-421b-4187-99a6-e18e4a01bfc9 in Status: SUCCESS [ 815.562047] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.562233] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.562452] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.563324] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.563515] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.563596] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.563777] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.563857] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.563949] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.564085] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('96047272-421b-4187-99a6-e18e4a01bfc9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.565163] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.565163] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.565314] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.565391] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.565445] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.566037] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.566037] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.566037] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('96047272-421b-4187-99a6-e18e4a01bfc9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.640159] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.640453] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.640453] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.640753] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.641096] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.641161] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc is going to be updated. [ 815.673039] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.673179] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.673254] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.673466] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.673604] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.684875] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc in Status: IN_PROGRESS for 2s [ 815.735030] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.735200] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.735287] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.735514] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.735617] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.736055] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.736055] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.736055] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.736202] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.736202] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.736603] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02ce0770-2d9f-451b-8bc9-6982e5dbf513 is going to be updated. [ 815.772643] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.772643] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.772643] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.772643] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.772643] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.780385] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02ce0770-2d9f-451b-8bc9-6982e5dbf513 in Status: IN_PROGRESS for 2s [ 816.068832] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-96047272-421b-4187-99a6-e18e4a01bfc9 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.068832] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.068832] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('96047272-421b-4187-99a6-e18e4a01bfc9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.202229] env[68328]: INFO networking_nsxv3.common.synchronization [req-24a7625d-83e5-4232-aee3-97eb61071b82 req-879b6e06-c341-402f-b8f8-5e3daa3d9406 tempest-SecurityGroupsTestJSON-429138018 tempest-SecurityGroupsTestJSON-429138018-project-member] Enqueued Resource ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 with Priority: HIGHEST for action security_group_members [ 816.202229] env[68328]: INFO networking_nsxv3.common.synchronization [req-24a7625d-83e5-4232-aee3-97eb61071b82 req-879b6e06-c341-402f-b8f8-5e3daa3d9406 tempest-SecurityGroupsTestJSON-429138018 tempest-SecurityGroupsTestJSON-429138018-project-member] Enqueued Resource ID: 70738fbe-b41d-467c-86c7-92a8c5a2a723 with Priority: HIGHEST for action security_group_members [ 816.202229] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 with Priority: HIGHEST for action security_group_members [ 816.202229] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70738fbe-b41d-467c-86c7-92a8c5a2a723 with Priority: HIGHEST for action security_group_members [ 816.202902] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-870ec36b-ba1d-4422-a26d-1328f51f79e4 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.203948] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.203948] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.203948] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.203948] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.203948] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.203948] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.206022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.206022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.206022] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.206022] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-70738fbe-b41d-467c-86c7-92a8c5a2a723 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.206022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70738fbe-b41d-467c-86c7-92a8c5a2a723" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.206022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70738fbe-b41d-467c-86c7-92a8c5a2a723" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.206022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70738fbe-b41d-467c-86c7-92a8c5a2a723" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.207017] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.207017] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.207017] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.207017] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.207017] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.209215] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70738fbe-b41d-467c-86c7-92a8c5a2a723',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.295643] env[68328]: INFO networking_nsxv3.common.synchronization [req-24a7625d-83e5-4232-aee3-97eb61071b82 req-879b6e06-c341-402f-b8f8-5e3daa3d9406 tempest-SecurityGroupsTestJSON-429138018 tempest-SecurityGroupsTestJSON-429138018-project-member] Enqueued Resource ID: 70738fbe-b41d-467c-86c7-92a8c5a2a723 with Priority: HIGHEST for action security_group_rules [ 816.295643] env[68328]: INFO networking_nsxv3.common.synchronization [req-24a7625d-83e5-4232-aee3-97eb61071b82 req-879b6e06-c341-402f-b8f8-5e3daa3d9406 tempest-SecurityGroupsTestJSON-429138018 tempest-SecurityGroupsTestJSON-429138018-project-member] Enqueued Resource ID: 70738fbe-b41d-467c-86c7-92a8c5a2a723 with Priority: HIGHEST for action security_group_members [ 816.295643] env[68328]: INFO networking_nsxv3.common.synchronization [req-24a7625d-83e5-4232-aee3-97eb61071b82 req-879b6e06-c341-402f-b8f8-5e3daa3d9406 tempest-SecurityGroupsTestJSON-429138018 tempest-SecurityGroupsTestJSON-429138018-project-member] Enqueued Resource ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 with Priority: HIGHEST for action security_group_rules [ 816.295643] env[68328]: INFO networking_nsxv3.common.synchronization [req-24a7625d-83e5-4232-aee3-97eb61071b82 req-879b6e06-c341-402f-b8f8-5e3daa3d9406 tempest-SecurityGroupsTestJSON-429138018 tempest-SecurityGroupsTestJSON-429138018-project-member] Enqueued Resource ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 with Priority: HIGHEST for action security_group_members [ 816.295643] env[68328]: INFO networking_nsxv3.common.synchronization [req-24a7625d-83e5-4232-aee3-97eb61071b82 req-879b6e06-c341-402f-b8f8-5e3daa3d9406 tempest-SecurityGroupsTestJSON-429138018 tempest-SecurityGroupsTestJSON-429138018-project-member] Enqueued Resource ID: bd68cdf0-4228-4df5-9676-402abe5b5b2f with Priority: HIGHEST for action port [ 816.295643] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70738fbe-b41d-467c-86c7-92a8c5a2a723 with Priority: HIGHEST for action security_group_rules [ 816.295643] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 with Priority: HIGHEST for action security_group_rules [ 816.295643] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd68cdf0-4228-4df5-9676-402abe5b5b2f with Priority: HIGHEST for action port [ 816.296243] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70738fbe-b41d-467c-86c7-92a8c5a2a723 with Priority: HIGHEST for action security_group_members [ 816.296516] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 with Priority: HIGHEST for action security_group_members [ 816.296909] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70738fbe-b41d-467c-86c7-92a8c5a2a723 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.297335] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70738fbe-b41d-467c-86c7-92a8c5a2a723" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.297335] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70738fbe-b41d-467c-86c7-92a8c5a2a723" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.299025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70738fbe-b41d-467c-86c7-92a8c5a2a723" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.299025] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70738fbe-b41d-467c-86c7-92a8c5a2a723',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.299025] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-870ec36b-ba1d-4422-a26d-1328f51f79e4 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.299025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.299025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.300016] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.300208] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.302028] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd68cdf0-4228-4df5-9676-402abe5b5b2f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.302028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd68cdf0-4228-4df5-9676-402abe5b5b2f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.302028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd68cdf0-4228-4df5-9676-402abe5b5b2f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.302028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd68cdf0-4228-4df5-9676-402abe5b5b2f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.302028] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd68cdf0-4228-4df5-9676-402abe5b5b2f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.303512] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-70738fbe-b41d-467c-86c7-92a8c5a2a723 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.303512] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70738fbe-b41d-467c-86c7-92a8c5a2a723" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.304349] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-870ec36b-ba1d-4422-a26d-1328f51f79e4 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.304349] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.500576] env[68328]: INFO networking_nsxv3.common.synchronization [req-89e79a04-42d9-46b5-ae1f-e290afeb6013 req-c0f5d488-905b-46f6-9f5d-f1ffbd1fbcaf service nova] Enqueued Resource ID: 96047272-421b-4187-99a6-e18e4a01bfc9 with Priority: HIGHEST for action security_group_rules [ 816.500774] env[68328]: INFO networking_nsxv3.common.synchronization [req-89e79a04-42d9-46b5-ae1f-e290afeb6013 req-c0f5d488-905b-46f6-9f5d-f1ffbd1fbcaf service nova] Enqueued Resource ID: 96047272-421b-4187-99a6-e18e4a01bfc9 with Priority: HIGHEST for action security_group_members [ 816.500926] env[68328]: INFO networking_nsxv3.common.synchronization [req-89e79a04-42d9-46b5-ae1f-e290afeb6013 req-c0f5d488-905b-46f6-9f5d-f1ffbd1fbcaf service nova] Enqueued Resource ID: 8a91ae12-1762-481c-9e92-2521149496f5 with Priority: HIGHEST for action port [ 816.501171] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96047272-421b-4187-99a6-e18e4a01bfc9 with Priority: HIGHEST for action security_group_rules [ 816.501324] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96047272-421b-4187-99a6-e18e4a01bfc9 with Priority: HIGHEST for action security_group_members [ 816.501425] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a91ae12-1762-481c-9e92-2521149496f5 with Priority: HIGHEST for action port [ 816.502009] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-96047272-421b-4187-99a6-e18e4a01bfc9 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.502520] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.502761] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-96047272-421b-4187-99a6-e18e4a01bfc9 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.502855] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.503083] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a91ae12-1762-481c-9e92-2521149496f5 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.503755] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a91ae12-1762-481c-9e92-2521149496f5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.503755] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a91ae12-1762-481c-9e92-2521149496f5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.503755] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a91ae12-1762-481c-9e92-2521149496f5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.503755] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a91ae12-1762-481c-9e92-2521149496f5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.541217] env[68328]: INFO networking_nsxv3.common.synchronization [req-a5a5d4a8-517f-40e3-ad6b-016c5c82cea2 req-869ec825-4f68-4239-8f5b-762c69914f47 tempest-VolumesAssistedSnapshotsTest-819686352 tempest-VolumesAssistedSnapshotsTest-819686352-project-member] Enqueued Resource ID: 57b7bbe5-8e54-4d67-b8c6-8cfc418f7042 with Priority: HIGHEST for action security_group_members [ 816.541217] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57b7bbe5-8e54-4d67-b8c6-8cfc418f7042 with Priority: HIGHEST for action security_group_members [ 816.541414] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-57b7bbe5-8e54-4d67-b8c6-8cfc418f7042 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.541584] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57b7bbe5-8e54-4d67-b8c6-8cfc418f7042" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.541668] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57b7bbe5-8e54-4d67-b8c6-8cfc418f7042" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.541910] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57b7bbe5-8e54-4d67-b8c6-8cfc418f7042" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.542596] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.542779] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.542867] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.544556] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.544658] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.544758] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57b7bbe5-8e54-4d67-b8c6-8cfc418f7042',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.570765] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('96047272-421b-4187-99a6-e18e4a01bfc9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.709131] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.709842] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('70738fbe-b41d-467c-86c7-92a8c5a2a723',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.806388] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-870ec36b-ba1d-4422-a26d-1328f51f79e4 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.806388] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.806388] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bd68cdf0-4228-4df5-9676-402abe5b5b2f with status ACTIVE [ 816.806540] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.806540] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.806662] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.806812] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.806907] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.807090] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.807184] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.807236] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.807387] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.807605] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.807670] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.807722] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.807774] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.809136] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.809136] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.809136] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bd68cdf0-4228-4df5-9676-402abe5b5b2f is going to be updated. [ 816.809451] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-70738fbe-b41d-467c-86c7-92a8c5a2a723 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.809599] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70738fbe-b41d-467c-86c7-92a8c5a2a723" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.830141] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.830141] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.830141] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.830141] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.830141] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.830141] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd68cdf0-4228-4df5-9676-402abe5b5b2f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.006727] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8a91ae12-1762-481c-9e92-2521149496f5 with status ACTIVE [ 817.007043] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.007236] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.007312] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.007543] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.007637] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.007886] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.007997] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.008095] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.010378] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.010378] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.010378] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.010378] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.010378] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.010378] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.010378] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.010378] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8a91ae12-1762-481c-9e92-2521149496f5 is going to be updated. [ 817.030246] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.030441] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.030511] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.030758] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.030920] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.031108] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a91ae12-1762-481c-9e92-2521149496f5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.047741] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.048032] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.048144] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.048419] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.048540] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.048891] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.048948] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.048980] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.049492] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.049492] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.049492] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57b7bbe5-8e54-4d67-b8c6-8cfc418f7042 is going to be updated. [ 817.075388] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.075601] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.075771] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.076070] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.076192] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.076297] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96047272-421b-4187-99a6-e18e4a01bfc9 is going to be updated. [ 817.078168] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.078337] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.078457] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.078648] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.078782] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.088756] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57b7bbe5-8e54-4d67-b8c6-8cfc418f7042 in Status: IN_PROGRESS for 2s [ 817.126546] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.127560] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.127560] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.127560] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.127560] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.136180] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96047272-421b-4187-99a6-e18e4a01bfc9 in Status: IN_PROGRESS for 2s [ 817.213665] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.214664] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('70738fbe-b41d-467c-86c7-92a8c5a2a723',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.597998] env[68328]: INFO networking_nsxv3.common.synchronization [req-13d59e15-9358-4049-b5d3-674a989fea2e req-cf4d4128-9fc5-4384-9974-e58cd646a8b1 tempest-MigrationsAdminTest-1924704487 tempest-MigrationsAdminTest-1924704487-project-member] Enqueued Resource ID: ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 with Priority: HIGHEST for action security_group_members [ 817.598588] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 with Priority: HIGHEST for action security_group_members [ 817.598900] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.599077] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.599121] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.600033] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.600033] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.600033] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.600033] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.600033] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.600033] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.600033] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ccbebeb4-60d7-4344-b96e-b9dfdeae14b1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.701124] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc in Status: SUCCESS [ 817.701371] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.701590] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.701945] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.702055] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.702150] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.702215] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.702400] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.702480] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.702561] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.702713] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.702852] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.702886] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.703148] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.703224] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.703317] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.703381] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.703539] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.703605] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.703684] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.703796] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ba6f8661-b38c-4d97-a1c5-4a0e33e341bc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.719574] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.719924] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.719924] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.720059] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.720148] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.720245] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 is going to be updated. [ 817.721635] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.721756] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.721796] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.721980] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.722076] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.722165] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70738fbe-b41d-467c-86c7-92a8c5a2a723 is going to be created. [ 817.748720] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.750873] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.751248] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.751776] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.751776] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.755097] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.755097] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.755097] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.756018] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.756018] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.766865] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70738fbe-b41d-467c-86c7-92a8c5a2a723 in Status: UNINITIALIZED for 2s [ 817.768983] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 in Status: IN_PROGRESS for 2s [ 817.788044] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02ce0770-2d9f-451b-8bc9-6982e5dbf513 in Status: SUCCESS [ 817.788552] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02ce0770-2d9f-451b-8bc9-6982e5dbf513 deletion is rescheduled due to dependency. [ 817.788552] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02ce0770-2d9f-451b-8bc9-6982e5dbf513" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.007548] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-739 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.007753] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-739" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.007880] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-739" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.009390] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-739" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.009787] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.010200] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.010388] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.010723] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.011694] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.011694] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 818.011694] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 818.011694] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 818.011694] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 818.011694] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 818.011694] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 818.011964] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 818.029062] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 818.032194] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 818.032194] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 818.032194] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-739" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.032194] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-8c39683a-4389-4f78-9682-37c95f18f308 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.032194] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-8c39683a-4389-4f78-9682-37c95f18f308" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.032194] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-8c39683a-4389-4f78-9682-37c95f18f308" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.034200] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-8c39683a-4389-4f78-9682-37c95f18f308" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.034692] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c39683a-4389-4f78-9682-37c95f18f308',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.103288] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ccbebeb4-60d7-4344-b96e-b9dfdeae14b1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.235447] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ba6f8661-b38c-4d97-a1c5-4a0e33e341bc: rpc.has_security_group_logging(os_id): False [ 818.259279] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.259279] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.259279] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.259605] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.259605] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.259819] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.261403] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.261403] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.261403] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.261403] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.261403] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.261403] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.261403] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.261403] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.261403] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.261403] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.261403] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.261403] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.261895] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.261895] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.261895] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc is going to be updated. [ 818.328750] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.328750] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.328750] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.328750] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.328750] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.341550] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc in Status: IN_PROGRESS for 2s [ 818.540201] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.540480] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.541084] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.541214] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.541881] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.541881] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 8c39683a-4389-4f78-9682-37c95f18f308 not found, creating... [ 818.542206] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.542206] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.544089] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.544089] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.544089] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.544089] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.544245] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.544540] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.544664] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.545150] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.545150] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 8c39683a-4389-4f78-9682-37c95f18f308 is going to be created. [ 818.571885] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.572319] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.572521] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.572935] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.573309] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.573659] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-8c39683a-4389-4f78-9682-37c95f18f308" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.606177] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ccbebeb4-60d7-4344-b96e-b9dfdeae14b1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.102449] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57b7bbe5-8e54-4d67-b8c6-8cfc418f7042 in Status: SUCCESS [ 819.102797] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57b7bbe5-8e54-4d67-b8c6-8cfc418f7042 deletion is rescheduled due to dependency. [ 819.102980] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57b7bbe5-8e54-4d67-b8c6-8cfc418f7042" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.113572] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.113739] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.113810] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.114119] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.114221] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.114276] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 is going to be updated. [ 819.146471] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96047272-421b-4187-99a6-e18e4a01bfc9 in Status: SUCCESS [ 819.146683] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.146871] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.147130] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.150100] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.150100] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.150100] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.150100] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.150100] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.150100] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.150100] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-96047272-421b-4187-99a6-e18e4a01bfc9 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.150100] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.150100] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.150100] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.150100] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.150100] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.150100] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.150100] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.150100] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.150100] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.150100] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('96047272-421b-4187-99a6-e18e4a01bfc9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.151126] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.151126] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.151126] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.151324] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.151324] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.152423] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.152590] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.152785] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.152985] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.152985] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.153107] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.153154] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.153452] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('96047272-421b-4187-99a6-e18e4a01bfc9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.160979] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 in Status: IN_PROGRESS for 2s [ 819.542695] env[68328]: INFO networking_nsxv3.common.synchronization [req-13d59e15-9358-4049-b5d3-674a989fea2e req-89645f5f-5c98-4be4-a5b2-fe18bd699d76 service nova] Enqueued Resource ID: ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 with Priority: HIGHEST for action security_group_rules [ 819.542695] env[68328]: INFO networking_nsxv3.common.synchronization [req-13d59e15-9358-4049-b5d3-674a989fea2e req-89645f5f-5c98-4be4-a5b2-fe18bd699d76 service nova] Enqueued Resource ID: ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 with Priority: HIGHEST for action security_group_members [ 819.542856] env[68328]: INFO networking_nsxv3.common.synchronization [req-13d59e15-9358-4049-b5d3-674a989fea2e req-89645f5f-5c98-4be4-a5b2-fe18bd699d76 service nova] Enqueued Resource ID: 8c39683a-4389-4f78-9682-37c95f18f308 with Priority: HIGHEST for action port [ 819.544088] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 with Priority: HIGHEST for action security_group_rules [ 819.544154] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 with Priority: HIGHEST for action security_group_members [ 819.544597] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c39683a-4389-4f78-9682-37c95f18f308 with Priority: HIGHEST for action port [ 819.544947] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.545115] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.545194] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.545411] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.545492] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ccbebeb4-60d7-4344-b96e-b9dfdeae14b1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.546890] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.547038] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.547258] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c39683a-4389-4f78-9682-37c95f18f308 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.547375] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c39683a-4389-4f78-9682-37c95f18f308" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.547375] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c39683a-4389-4f78-9682-37c95f18f308" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.547508] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c39683a-4389-4f78-9682-37c95f18f308" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.547599] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c39683a-4389-4f78-9682-37c95f18f308',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.657481] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 96047272-421b-4187-99a6-e18e4a01bfc9: rpc.has_security_group_logging(os_id): False [ 819.657481] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('96047272-421b-4187-99a6-e18e4a01bfc9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.662900] env[68328]: INFO networking_nsxv3.common.synchronization [req-5c9ba9bc-1c62-40fc-b425-ebc3bb5c3967 req-a9c3e075-20ff-4c99-936b-746a6c16e072 tempest-ServersTestManualDisk-40743403 tempest-ServersTestManualDisk-40743403-project-member] Enqueued Resource ID: 3826a056-9a94-48ea-97d8-49b840d3fb63 with Priority: HIGHEST for action security_group_members [ 819.663273] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3826a056-9a94-48ea-97d8-49b840d3fb63 with Priority: HIGHEST for action security_group_members [ 819.663660] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-3826a056-9a94-48ea-97d8-49b840d3fb63 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.663836] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3826a056-9a94-48ea-97d8-49b840d3fb63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.663947] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3826a056-9a94-48ea-97d8-49b840d3fb63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.664209] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3826a056-9a94-48ea-97d8-49b840d3fb63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.664423] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.664584] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.664686] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.664875] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.665014] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.665356] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3826a056-9a94-48ea-97d8-49b840d3fb63',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.677476] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.677476] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.677476] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.678068] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.678068] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.678936] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.678936] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.678936] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.678936] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.678936] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.679387] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.679551] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.679653] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.679874] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.680121] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.680418] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.680541] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.680772] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.681018] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.681225] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.681716] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 96047272-421b-4187-99a6-e18e4a01bfc9 is going to be updated. [ 819.741788] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.741980] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.742089] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.742384] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.742608] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.755052] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 96047272-421b-4187-99a6-e18e4a01bfc9 in Status: IN_PROGRESS for 2s [ 819.777995] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70738fbe-b41d-467c-86c7-92a8c5a2a723 in Status: SUCCESS [ 819.778172] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70738fbe-b41d-467c-86c7-92a8c5a2a723" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.778301] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70738fbe-b41d-467c-86c7-92a8c5a2a723" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.778538] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70738fbe-b41d-467c-86c7-92a8c5a2a723" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.778754] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.778863] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.779180] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.779239] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.779322] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.779409] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70738fbe-b41d-467c-86c7-92a8c5a2a723',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.782294] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 in Status: SUCCESS [ 819.782294] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.782294] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.782294] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.782294] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.782294] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.782294] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.782294] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.782294] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.782294] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.049414] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8c39683a-4389-4f78-9682-37c95f18f308 with status ACTIVE [ 820.049655] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.049796] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.049854] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.050306] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.050306] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.050481] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.050586] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.050690] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.050823] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.051022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.051082] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.051170] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.051222] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.051375] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.051441] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.051502] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8c39683a-4389-4f78-9682-37c95f18f308 is going to be updated. [ 820.052713] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.052810] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.079667] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.079998] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.080088] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.080283] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.080416] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.080584] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c39683a-4389-4f78-9682-37c95f18f308" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.161566] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('96047272-421b-4187-99a6-e18e4a01bfc9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.167531] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.167688] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.167759] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.168160] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.168160] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.168335] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.168437] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.168498] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.168649] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.168724] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.168810] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3826a056-9a94-48ea-97d8-49b840d3fb63 is going to be updated. [ 820.201737] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.201922] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.202046] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.202231] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.202366] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.218384] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3826a056-9a94-48ea-97d8-49b840d3fb63 in Status: IN_PROGRESS for 2s [ 820.284925] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('70738fbe-b41d-467c-86c7-92a8c5a2a723',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.290093] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.353248] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc in Status: SUCCESS [ 820.354048] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.354260] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.354490] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.354583] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba6f8661-b38c-4d97-a1c5-4a0e33e341bc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.389357] env[68328]: INFO networking_nsxv3.common.synchronization [req-97b08612-c3e5-4ba9-8b66-f98df360db1c req-b4502126-cb76-4a1a-99e6-90cc0ef552c6 tempest-ServersAdminTestJSON-340534059 tempest-ServersAdminTestJSON-340534059-project-member] Enqueued Resource ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed with Priority: HIGHEST for action security_group_members [ 820.393223] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed with Priority: HIGHEST for action security_group_members [ 820.394486] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.394666] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.394750] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.394954] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.395167] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.396161] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.396161] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.396161] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.396161] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.396161] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.398089] env[68328]: INFO networking_nsxv3.common.synchronization [req-7ff4099a-3a81-4183-8ae4-5b2c2f3ea6a6 req-015ea4fb-d2de-42aa-939d-e564ca2a1c71 tempest-FloatingIPsAssociationNegativeTestJSON-979815897 tempest-FloatingIPsAssociationNegativeTestJSON-979815897-project-member] Enqueued Resource ID: f0811b65-cde4-4246-a2e0-5bbd90921f5b with Priority: HIGHEST for action security_group_members [ 820.398404] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0811b65-cde4-4246-a2e0-5bbd90921f5b with Priority: HIGHEST for action security_group_members [ 820.398763] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0811b65-cde4-4246-a2e0-5bbd90921f5b taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.398926] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0811b65-cde4-4246-a2e0-5bbd90921f5b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.399048] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0811b65-cde4-4246-a2e0-5bbd90921f5b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.399197] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0811b65-cde4-4246-a2e0-5bbd90921f5b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.399367] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.399518] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.399694] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.399951] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.400082] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.400134] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0811b65-cde4-4246-a2e0-5bbd90921f5b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.449137] env[68328]: INFO networking_nsxv3.common.synchronization [req-84acac5c-8452-49f8-b276-3ac16cef7a84 req-c5b3a397-3da4-4d3b-8dbf-e7da2a95ed67 tempest-ServersTestMultiNic-360170984 tempest-ServersTestMultiNic-360170984-project-member] Enqueued Resource ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc with Priority: HIGHEST for action security_group_members [ 820.450144] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc with Priority: HIGHEST for action security_group_members [ 820.450370] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.450505] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.450565] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.450768] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.450946] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.451244] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.451244] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.451370] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.451415] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.451495] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba6f8661-b38c-4d97-a1c5-4a0e33e341bc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.665021] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.665418] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.665558] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.666104] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.666252] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.666378] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96047272-421b-4187-99a6-e18e4a01bfc9 is going to be updated. [ 820.692886] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.693071] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.693137] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.693348] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.693499] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.701539] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96047272-421b-4187-99a6-e18e4a01bfc9 in Status: IN_PROGRESS for 2s [ 820.723701] env[68328]: INFO networking_nsxv3.common.synchronization [req-84acac5c-8452-49f8-b276-3ac16cef7a84 req-9c0a169f-b701-4945-af34-144f7bc3b131 tempest-ServersTestMultiNic-360170984 tempest-ServersTestMultiNic-360170984-project-member] Enqueued Resource ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc with Priority: HIGHEST for action security_group_members [ 820.724802] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc with Priority: HIGHEST for action security_group_members [ 820.724802] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.724802] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.792329] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('70738fbe-b41d-467c-86c7-92a8c5a2a723',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.793529] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.856711] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.856848] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.899443] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.906557] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.906557] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.906557] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.906557] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.906557] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.906557] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.906557] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.906557] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.906557] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.906944] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.906944] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0811b65-cde4-4246-a2e0-5bbd90921f5b is going to be updated. [ 820.941256] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.941256] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.941256] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.941256] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.941256] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.946990] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0811b65-cde4-4246-a2e0-5bbd90921f5b in Status: IN_PROGRESS for 2s [ 820.955558] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ba6f8661-b38c-4d97-a1c5-4a0e33e341bc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.176442] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 in Status: SUCCESS [ 821.176758] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.177591] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.183078] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.183078] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.183078] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.183078] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.183078] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.183078] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.183078] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ccbebeb4-60d7-4344-b96e-b9dfdeae14b1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.295893] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.296100] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.296192] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.296491] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.296593] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.296712] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70738fbe-b41d-467c-86c7-92a8c5a2a723 is going to be updated. [ 821.298179] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.298300] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.298359] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.298609] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.298717] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.298851] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 is going to be updated. [ 821.336357] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.336599] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.336756] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.337101] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.337357] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.342747] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.342901] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.342971] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.343260] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.343509] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.356837] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 in Status: IN_PROGRESS for 2s [ 821.357825] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70738fbe-b41d-467c-86c7-92a8c5a2a723 in Status: IN_PROGRESS for 2s [ 821.404525] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.457822] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ba6f8661-b38c-4d97-a1c5-4a0e33e341bc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.685542] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ccbebeb4-60d7-4344-b96e-b9dfdeae14b1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.768251] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 96047272-421b-4187-99a6-e18e4a01bfc9 in Status: SUCCESS [ 821.768251] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.768251] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.768251] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.768251] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('96047272-421b-4187-99a6-e18e4a01bfc9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.909182] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.909182] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.909182] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.909182] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.909182] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.909182] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed is going to be updated. [ 821.948421] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.948730] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.948730] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.948985] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.949151] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.961301] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed in Status: IN_PROGRESS for 2s [ 821.961568] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.961698] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.961768] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.961975] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.962081] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.962175] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc is going to be updated. [ 821.990685] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.990901] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.990901] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.991306] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.991512] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.000332] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc in Status: IN_PROGRESS for 2s [ 822.189029] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ccbebeb4-60d7-4344-b96e-b9dfdeae14b1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.229490] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3826a056-9a94-48ea-97d8-49b840d3fb63 in Status: SUCCESS [ 822.229695] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3826a056-9a94-48ea-97d8-49b840d3fb63 deletion is rescheduled due to dependency. [ 822.229796] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3826a056-9a94-48ea-97d8-49b840d3fb63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.269418] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-96047272-421b-4187-99a6-e18e4a01bfc9 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.269549] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.692027] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.692149] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.692149] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.692391] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.692482] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.692583] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 is going to be updated. [ 822.711866] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96047272-421b-4187-99a6-e18e4a01bfc9 in Status: SUCCESS [ 822.712322] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.714032] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.714032] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.714032] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.714032] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.714032] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.714032] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.714032] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.714032] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.714032] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('96047272-421b-4187-99a6-e18e4a01bfc9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.724167] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.724167] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.724167] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.725441] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.725441] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.733897] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 in Status: IN_PROGRESS for 2s [ 822.956771] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0811b65-cde4-4246-a2e0-5bbd90921f5b in Status: SUCCESS [ 822.957029] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0811b65-cde4-4246-a2e0-5bbd90921f5b deletion is rescheduled due to dependency. [ 822.957152] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0811b65-cde4-4246-a2e0-5bbd90921f5b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.216832] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-96047272-421b-4187-99a6-e18e4a01bfc9 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.217212] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.217212] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.217333] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.217574] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.217685] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.217747] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.217943] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.218171] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.218288] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.218460] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-96047272-421b-4187-99a6-e18e4a01bfc9 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.218566] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.218623] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.218786] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.218929] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.219036] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.219096] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.219255] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.219722] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.219722] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.219722] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('96047272-421b-4187-99a6-e18e4a01bfc9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.367471] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 in Status: SUCCESS [ 823.367750] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.367938] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.368579] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.368579] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.368579] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.368791] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.368791] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.368859] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.368944] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.369185] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.370695] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70738fbe-b41d-467c-86c7-92a8c5a2a723 in Status: SUCCESS [ 823.370883] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70738fbe-b41d-467c-86c7-92a8c5a2a723" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.371227] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70738fbe-b41d-467c-86c7-92a8c5a2a723" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.371313] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70738fbe-b41d-467c-86c7-92a8c5a2a723" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.371442] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.371538] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.371600] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.372375] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.372375] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.372375] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70738fbe-b41d-467c-86c7-92a8c5a2a723" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.372375] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('70738fbe-b41d-467c-86c7-92a8c5a2a723',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.727314] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 96047272-421b-4187-99a6-e18e4a01bfc9: rpc.has_security_group_logging(os_id): False [ 823.745813] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.746087] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.746087] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.746262] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.746358] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.746565] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.746660] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.746724] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.746877] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.746939] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.747157] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.747256] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.747316] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.747476] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.747569] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.747679] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.747761] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.747895] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.748027] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.750249] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.750249] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 96047272-421b-4187-99a6-e18e4a01bfc9 is going to be updated. [ 823.804836] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.805019] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.805117] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.805352] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.805497] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.825161] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 96047272-421b-4187-99a6-e18e4a01bfc9 in Status: IN_PROGRESS for 2s [ 823.874175] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-870ec36b-ba1d-4422-a26d-1328f51f79e4 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.874380] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.874425] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.874663] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.874832] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.874929] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.874993] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.875162] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.875250] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.875337] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.875482] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-870ec36b-ba1d-4422-a26d-1328f51f79e4 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.875574] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.875632] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.875773] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.875906] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.875994] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.876065] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.876201] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.876275] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.876353] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.876439] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.877393] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('70738fbe-b41d-467c-86c7-92a8c5a2a723',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.970726] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed in Status: SUCCESS [ 823.970916] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.009678] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc in Status: SUCCESS [ 824.009909] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.010194] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.010441] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.010633] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.010752] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.011246] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.011246] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.011427] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.011473] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba6f8661-b38c-4d97-a1c5-4a0e33e341bc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.079121] env[68328]: INFO networking_nsxv3.common.synchronization [req-b2fc1593-19a7-4382-8356-3a024c71010f req-742804cc-f0da-49ca-90e4-65a10928901d tempest-SecurityGroupsTestJSON-429138018 tempest-SecurityGroupsTestJSON-429138018-project-member] Enqueued Resource ID: 70738fbe-b41d-467c-86c7-92a8c5a2a723 with Priority: HIGHEST for action security_group_members [ 824.079121] env[68328]: INFO networking_nsxv3.common.synchronization [req-b2fc1593-19a7-4382-8356-3a024c71010f req-742804cc-f0da-49ca-90e4-65a10928901d tempest-SecurityGroupsTestJSON-429138018 tempest-SecurityGroupsTestJSON-429138018-project-member] Enqueued Resource ID: 372986d1-e1d1-4c79-a20b-8d90ef31aef2 with Priority: HIGHEST for action security_group_members [ 824.079121] env[68328]: INFO networking_nsxv3.common.synchronization [req-b2fc1593-19a7-4382-8356-3a024c71010f req-742804cc-f0da-49ca-90e4-65a10928901d tempest-SecurityGroupsTestJSON-429138018 tempest-SecurityGroupsTestJSON-429138018-project-member] Enqueued Resource ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 with Priority: HIGHEST for action security_group_members [ 824.079519] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70738fbe-b41d-467c-86c7-92a8c5a2a723 with Priority: HIGHEST for action security_group_members [ 824.079650] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 372986d1-e1d1-4c79-a20b-8d90ef31aef2 with Priority: HIGHEST for action security_group_members [ 824.079752] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 with Priority: HIGHEST for action security_group_members [ 824.080110] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-70738fbe-b41d-467c-86c7-92a8c5a2a723 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.080247] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70738fbe-b41d-467c-86c7-92a8c5a2a723" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.080313] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70738fbe-b41d-467c-86c7-92a8c5a2a723" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.080519] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70738fbe-b41d-467c-86c7-92a8c5a2a723" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.080674] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.080761] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.080821] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.081204] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.081204] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.081204] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70738fbe-b41d-467c-86c7-92a8c5a2a723',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.082257] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-372986d1-e1d1-4c79-a20b-8d90ef31aef2 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.082257] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-372986d1-e1d1-4c79-a20b-8d90ef31aef2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.082257] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-372986d1-e1d1-4c79-a20b-8d90ef31aef2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.082484] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-372986d1-e1d1-4c79-a20b-8d90ef31aef2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.082819] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.082819] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.082819] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.082819] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.083051] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.083051] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('372986d1-e1d1-4c79-a20b-8d90ef31aef2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.083997] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-870ec36b-ba1d-4422-a26d-1328f51f79e4 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.083997] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.083997] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.084186] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.084274] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.084368] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.084434] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.084599] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.086718] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.086838] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.128545] env[68328]: INFO networking_nsxv3.common.synchronization [req-b2fc1593-19a7-4382-8356-3a024c71010f req-742804cc-f0da-49ca-90e4-65a10928901d tempest-SecurityGroupsTestJSON-429138018 tempest-SecurityGroupsTestJSON-429138018-project-member] Enqueued Resource ID: 372986d1-e1d1-4c79-a20b-8d90ef31aef2 with Priority: HIGHEST for action security_group_rules [ 824.128763] env[68328]: INFO networking_nsxv3.common.synchronization [req-b2fc1593-19a7-4382-8356-3a024c71010f req-742804cc-f0da-49ca-90e4-65a10928901d tempest-SecurityGroupsTestJSON-429138018 tempest-SecurityGroupsTestJSON-429138018-project-member] Enqueued Resource ID: 372986d1-e1d1-4c79-a20b-8d90ef31aef2 with Priority: HIGHEST for action security_group_members [ 824.128903] env[68328]: INFO networking_nsxv3.common.synchronization [req-b2fc1593-19a7-4382-8356-3a024c71010f req-742804cc-f0da-49ca-90e4-65a10928901d tempest-SecurityGroupsTestJSON-429138018 tempest-SecurityGroupsTestJSON-429138018-project-member] Enqueued Resource ID: 70738fbe-b41d-467c-86c7-92a8c5a2a723 with Priority: HIGHEST for action security_group_rules [ 824.129046] env[68328]: INFO networking_nsxv3.common.synchronization [req-b2fc1593-19a7-4382-8356-3a024c71010f req-742804cc-f0da-49ca-90e4-65a10928901d tempest-SecurityGroupsTestJSON-429138018 tempest-SecurityGroupsTestJSON-429138018-project-member] Enqueued Resource ID: 70738fbe-b41d-467c-86c7-92a8c5a2a723 with Priority: HIGHEST for action security_group_members [ 824.129182] env[68328]: INFO networking_nsxv3.common.synchronization [req-b2fc1593-19a7-4382-8356-3a024c71010f req-742804cc-f0da-49ca-90e4-65a10928901d tempest-SecurityGroupsTestJSON-429138018 tempest-SecurityGroupsTestJSON-429138018-project-member] Enqueued Resource ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 with Priority: HIGHEST for action security_group_rules [ 824.129354] env[68328]: INFO networking_nsxv3.common.synchronization [req-b2fc1593-19a7-4382-8356-3a024c71010f req-742804cc-f0da-49ca-90e4-65a10928901d tempest-SecurityGroupsTestJSON-429138018 tempest-SecurityGroupsTestJSON-429138018-project-member] Enqueued Resource ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 with Priority: HIGHEST for action security_group_members [ 824.129504] env[68328]: INFO networking_nsxv3.common.synchronization [req-b2fc1593-19a7-4382-8356-3a024c71010f req-742804cc-f0da-49ca-90e4-65a10928901d tempest-SecurityGroupsTestJSON-429138018 tempest-SecurityGroupsTestJSON-429138018-project-member] Enqueued Resource ID: bd68cdf0-4228-4df5-9676-402abe5b5b2f with Priority: HIGHEST for action port [ 824.130068] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 372986d1-e1d1-4c79-a20b-8d90ef31aef2 with Priority: HIGHEST for action security_group_rules [ 824.130326] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70738fbe-b41d-467c-86c7-92a8c5a2a723 with Priority: HIGHEST for action security_group_rules [ 824.130326] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 with Priority: HIGHEST for action security_group_members [ 824.130494] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd68cdf0-4228-4df5-9676-402abe5b5b2f with Priority: HIGHEST for action port [ 824.130494] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 with Priority: HIGHEST for action security_group_rules [ 824.130689] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 372986d1-e1d1-4c79-a20b-8d90ef31aef2 with Priority: HIGHEST for action security_group_members [ 824.130689] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70738fbe-b41d-467c-86c7-92a8c5a2a723 with Priority: HIGHEST for action security_group_members [ 824.130892] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-372986d1-e1d1-4c79-a20b-8d90ef31aef2 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.131120] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-372986d1-e1d1-4c79-a20b-8d90ef31aef2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.131120] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-372986d1-e1d1-4c79-a20b-8d90ef31aef2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.131356] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-372986d1-e1d1-4c79-a20b-8d90ef31aef2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.131438] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('372986d1-e1d1-4c79-a20b-8d90ef31aef2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.132490] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70738fbe-b41d-467c-86c7-92a8c5a2a723 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.132490] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70738fbe-b41d-467c-86c7-92a8c5a2a723" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.132810] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-870ec36b-ba1d-4422-a26d-1328f51f79e4 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.132810] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.132810] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd68cdf0-4228-4df5-9676-402abe5b5b2f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.133030] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd68cdf0-4228-4df5-9676-402abe5b5b2f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.133030] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd68cdf0-4228-4df5-9676-402abe5b5b2f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.134510] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd68cdf0-4228-4df5-9676-402abe5b5b2f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.134510] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd68cdf0-4228-4df5-9676-402abe5b5b2f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.134924] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-870ec36b-ba1d-4422-a26d-1328f51f79e4 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.134924] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.134924] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-372986d1-e1d1-4c79-a20b-8d90ef31aef2 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.135194] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-372986d1-e1d1-4c79-a20b-8d90ef31aef2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.135194] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-70738fbe-b41d-467c-86c7-92a8c5a2a723 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.135311] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70738fbe-b41d-467c-86c7-92a8c5a2a723" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.378914] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 870ec36b-ba1d-4422-a26d-1328f51f79e4: rpc.has_security_group_logging(os_id): False [ 824.380192] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 70738fbe-b41d-467c-86c7-92a8c5a2a723: rpc.has_security_group_logging(os_id): False [ 824.406411] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.406609] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.406687] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.406997] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.407184] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.407384] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.407486] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.407552] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.407710] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.411092] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.411309] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70738fbe-b41d-467c-86c7-92a8c5a2a723 is going to be created. [ 824.413827] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.413993] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.414081] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.414260] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.414398] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.414655] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.414785] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.414875] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.415117] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.415225] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.415420] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.415517] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.415581] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.415784] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.417522] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.417522] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.417522] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.417522] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.417522] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.417522] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.417522] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 is going to be updated. [ 824.500534] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.500810] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.500864] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.501160] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.501378] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.516013] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.516185] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.516301] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.516730] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.516869] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.518333] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.518509] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.518574] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.518754] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.518962] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.519084] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.519231] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.519337] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.519414] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.519542] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.519653] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc is going to be updated. [ 824.528414] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70738fbe-b41d-467c-86c7-92a8c5a2a723 in Status: IN_PROGRESS for 2s [ 824.546225] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 in Status: IN_PROGRESS for 2s [ 824.587286] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.587502] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.587602] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.587883] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.588083] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.589358] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('372986d1-e1d1-4c79-a20b-8d90ef31aef2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.590499] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('70738fbe-b41d-467c-86c7-92a8c5a2a723',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.593237] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.600022] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc in Status: IN_PROGRESS for 2s [ 824.636783] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-372986d1-e1d1-4c79-a20b-8d90ef31aef2 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.636983] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-372986d1-e1d1-4c79-a20b-8d90ef31aef2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.637081] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bd68cdf0-4228-4df5-9676-402abe5b5b2f with status ACTIVE [ 824.637262] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.637375] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.637440] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.637662] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.637794] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.638037] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.638131] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.638131] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.638287] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.638368] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.638550] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.638681] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.638789] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.638854] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.638955] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.639022] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bd68cdf0-4228-4df5-9676-402abe5b5b2f is going to be updated. [ 824.667267] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.667469] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.667509] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.667956] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.667956] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.668248] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd68cdf0-4228-4df5-9676-402abe5b5b2f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.743490] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 in Status: SUCCESS [ 824.743743] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.743913] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.744181] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.744398] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.744516] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.744592] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.744741] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.744827] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.744915] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.745017] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ccbebeb4-60d7-4344-b96e-b9dfdeae14b1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.094419] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('372986d1-e1d1-4c79-a20b-8d90ef31aef2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.094419] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('70738fbe-b41d-467c-86c7-92a8c5a2a723',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.095962] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.247326] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.248101] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.248189] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.248434] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.248630] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.248756] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.248838] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.249030] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.249142] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.249232] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.249392] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.249484] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.249607] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.249701] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.249872] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.250150] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.250150] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.250383] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.250478] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.250626] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.250727] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ccbebeb4-60d7-4344-b96e-b9dfdeae14b1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.302011] env[68328]: INFO networking_nsxv3.common.synchronization [req-8d659fb6-2beb-4041-ac83-5f93e9986082 req-b1c84446-944d-4e69-bc41-e28647fdfcda tempest-ImagesOneServerNegativeTestJSON-288072164 tempest-ImagesOneServerNegativeTestJSON-288072164-project-member] Enqueued Resource ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 with Priority: HIGHEST for action security_group_members [ 825.302940] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 with Priority: HIGHEST for action security_group_members [ 825.303294] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-55f209f1-d8fe-4d5e-a886-797753b1b3c1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.303423] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.303490] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.303824] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.303996] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.304470] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.304535] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.304738] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.304828] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.305705] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55f209f1-d8fe-4d5e-a886-797753b1b3c1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.595345] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.595698] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.595698] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.595881] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.595933] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.596047] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 372986d1-e1d1-4c79-a20b-8d90ef31aef2 is going to be created. [ 825.597423] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.597536] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.597602] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.597785] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.597878] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.598047] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70738fbe-b41d-467c-86c7-92a8c5a2a723 is going to be updated. [ 825.599369] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.599369] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.599369] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.600378] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.600378] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.600378] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 is going to be updated. [ 825.634609] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.635625] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.635625] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.635625] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.635625] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.640716] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.641173] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.641565] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.642092] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.642351] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.645186] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.645500] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.645636] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.645926] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.646475] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.657950] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 372986d1-e1d1-4c79-a20b-8d90ef31aef2 in Status: UNINITIALIZED for 2s [ 825.660164] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70738fbe-b41d-467c-86c7-92a8c5a2a723 in Status: IN_PROGRESS for 2s [ 825.661476] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 in Status: IN_PROGRESS for 2s [ 825.754015] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ccbebeb4-60d7-4344-b96e-b9dfdeae14b1: rpc.has_security_group_logging(os_id): False [ 825.773360] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.773536] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.773620] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.773846] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.773997] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.774162] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.774268] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.774332] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.774543] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.774603] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.774801] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.774898] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.774970] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.775194] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.778429] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.778429] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.778429] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.778429] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.778429] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.778429] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.778429] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 is going to be updated. [ 825.808099] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.808269] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.808352] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.808678] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.808783] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.808995] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.809113] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.809163] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.809324] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.809394] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.809489] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 is going to be updated. [ 825.835168] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.835317] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.835390] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.835595] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.835732] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.837522] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.837648] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.837741] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.838452] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.838452] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.839680] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 96047272-421b-4187-99a6-e18e4a01bfc9 in Status: SUCCESS [ 825.839823] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.850854] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 in Status: IN_PROGRESS for 2s [ 825.850854] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 in Status: IN_PROGRESS for 2s [ 826.541402] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70738fbe-b41d-467c-86c7-92a8c5a2a723 in Status: SUCCESS [ 826.541810] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70738fbe-b41d-467c-86c7-92a8c5a2a723" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.542124] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70738fbe-b41d-467c-86c7-92a8c5a2a723" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.542476] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70738fbe-b41d-467c-86c7-92a8c5a2a723" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.542663] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70738fbe-b41d-467c-86c7-92a8c5a2a723',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.559464] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 in Status: SUCCESS [ 826.559724] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.560301] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.560526] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.560617] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.611031] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc in Status: SUCCESS [ 826.611385] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc deletion is rescheduled due to dependency. [ 826.611430] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.611613] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.614703] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.614986] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.615143] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.615242] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.615828] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.615828] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.615828] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.615828] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ba6f8661-b38c-4d97-a1c5-4a0e33e341bc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.641738] env[68328]: INFO networking_nsxv3.common.synchronization [req-29efdae4-b864-4129-a146-e34814e26e7d req-c51cbf9f-eb4c-438a-920d-80bfa7feabea tempest-ServersTestBootFromVolume-1101005300 tempest-ServersTestBootFromVolume-1101005300-project-member] Enqueued Resource ID: 6e39d3b8-c430-4219-9295-992b699ce546 with Priority: HIGHEST for action security_group_members [ 826.642449] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e39d3b8-c430-4219-9295-992b699ce546 with Priority: HIGHEST for action security_group_members [ 826.642931] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e39d3b8-c430-4219-9295-992b699ce546 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.643441] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e39d3b8-c430-4219-9295-992b699ce546" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.643441] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e39d3b8-c430-4219-9295-992b699ce546" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.643777] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e39d3b8-c430-4219-9295-992b699ce546" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.643975] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.644173] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.644278] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.644549] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.644679] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.644829] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e39d3b8-c430-4219-9295-992b699ce546',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.045242] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-70738fbe-b41d-467c-86c7-92a8c5a2a723 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.045435] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70738fbe-b41d-467c-86c7-92a8c5a2a723" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.063498] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-870ec36b-ba1d-4422-a26d-1328f51f79e4 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.063666] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.119302] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.119498] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.119576] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.119778] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.119942] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.120078] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.120139] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.120292] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.120378] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.120462] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.120605] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.120695] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.120756] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.120885] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.121029] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.121141] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.121203] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.121347] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.121421] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.121512] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.121593] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ba6f8661-b38c-4d97-a1c5-4a0e33e341bc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.151231] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.151231] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.151231] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.151231] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.151231] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.151231] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.151231] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.151231] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.151231] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.151231] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.151231] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e39d3b8-c430-4219-9295-992b699ce546 is going to be updated. [ 827.179992] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.180235] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.180235] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.181129] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.181129] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.189484] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e39d3b8-c430-4219-9295-992b699ce546 in Status: IN_PROGRESS for 2s [ 827.625876] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ba6f8661-b38c-4d97-a1c5-4a0e33e341bc: rpc.has_security_group_logging(os_id): False [ 827.656829] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.657060] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.657174] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.657499] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.657646] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.657893] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.658069] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.658148] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.658765] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.661473] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.661821] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.661998] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.662120] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.662450] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.662530] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.662844] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.662996] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.663128] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.663366] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.663489] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.663635] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc is going to be updated. [ 827.681574] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 372986d1-e1d1-4c79-a20b-8d90ef31aef2 in Status: SUCCESS [ 827.681873] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-372986d1-e1d1-4c79-a20b-8d90ef31aef2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.682675] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-372986d1-e1d1-4c79-a20b-8d90ef31aef2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.682889] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-372986d1-e1d1-4c79-a20b-8d90ef31aef2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.683159] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.683331] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.683446] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.683669] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.683811] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.683921] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('372986d1-e1d1-4c79-a20b-8d90ef31aef2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.685805] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70738fbe-b41d-467c-86c7-92a8c5a2a723 in Status: SUCCESS [ 827.686064] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70738fbe-b41d-467c-86c7-92a8c5a2a723" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.687112] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 in Status: SUCCESS [ 827.687341] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.687559] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70738fbe-b41d-467c-86c7-92a8c5a2a723" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.687797] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70738fbe-b41d-467c-86c7-92a8c5a2a723" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.688042] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.688213] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.688311] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.690018] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.690018] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.690018] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70738fbe-b41d-467c-86c7-92a8c5a2a723',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.690018] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.690415] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.690588] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.691462] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.691462] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.691462] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.691462] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.691462] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.737883] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.737883] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.737883] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.737883] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.737883] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.749201] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc in Status: IN_PROGRESS for 2s [ 827.808026] env[68328]: INFO networking_nsxv3.common.synchronization [req-d26e5ae4-6e89-4dce-b752-cad6ecf51a02 req-8703887b-2cb0-4794-8ff7-1f09f34f98d6 tempest-SecurityGroupsTestJSON-429138018 tempest-SecurityGroupsTestJSON-429138018-project-member] Enqueued Resource ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 with Priority: HIGHEST for action security_group_members [ 827.808026] env[68328]: INFO networking_nsxv3.common.synchronization [req-d26e5ae4-6e89-4dce-b752-cad6ecf51a02 req-8703887b-2cb0-4794-8ff7-1f09f34f98d6 tempest-SecurityGroupsTestJSON-429138018 tempest-SecurityGroupsTestJSON-429138018-project-member] Enqueued Resource ID: 70738fbe-b41d-467c-86c7-92a8c5a2a723 with Priority: HIGHEST for action security_group_members [ 827.808026] env[68328]: INFO networking_nsxv3.common.synchronization [req-d26e5ae4-6e89-4dce-b752-cad6ecf51a02 req-8703887b-2cb0-4794-8ff7-1f09f34f98d6 tempest-SecurityGroupsTestJSON-429138018 tempest-SecurityGroupsTestJSON-429138018-project-member] Enqueued Resource ID: 372986d1-e1d1-4c79-a20b-8d90ef31aef2 with Priority: HIGHEST for action security_group_members [ 827.808026] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 with Priority: HIGHEST for action security_group_members [ 827.808026] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70738fbe-b41d-467c-86c7-92a8c5a2a723 with Priority: HIGHEST for action security_group_members [ 827.808026] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 372986d1-e1d1-4c79-a20b-8d90ef31aef2 with Priority: HIGHEST for action security_group_members [ 827.808026] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-870ec36b-ba1d-4422-a26d-1328f51f79e4 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.808026] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.808783] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-70738fbe-b41d-467c-86c7-92a8c5a2a723 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.808982] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70738fbe-b41d-467c-86c7-92a8c5a2a723" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.809289] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-372986d1-e1d1-4c79-a20b-8d90ef31aef2 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.809959] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-372986d1-e1d1-4c79-a20b-8d90ef31aef2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.862674] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 in Status: SUCCESS [ 827.862893] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.863636] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 in Status: SUCCESS [ 827.863787] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 deletion is rescheduled due to dependency. [ 827.864203] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.196025] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('70738fbe-b41d-467c-86c7-92a8c5a2a723',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.196025] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('372986d1-e1d1-4c79-a20b-8d90ef31aef2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.197028] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.699543] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('70738fbe-b41d-467c-86c7-92a8c5a2a723',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.701443] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.701443] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('372986d1-e1d1-4c79-a20b-8d90ef31aef2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.196239] env[68328]: INFO networking_nsxv3.common.synchronization [req-3d2359bb-288f-4728-b675-f4bd2cc873fe req-b484b9e9-0c00-4f80-a081-355698ef4220 tempest-ServerActionsV293TestJSON-674787330 tempest-ServerActionsV293TestJSON-674787330-project-member] Enqueued Resource ID: 24a59c7c-3185-4ae4-af15-7deeba4a037c with Priority: HIGHEST for action security_group_members [ 829.196753] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24a59c7c-3185-4ae4-af15-7deeba4a037c with Priority: HIGHEST for action security_group_members [ 829.197060] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-24a59c7c-3185-4ae4-af15-7deeba4a037c taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.197181] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24a59c7c-3185-4ae4-af15-7deeba4a037c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.197240] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24a59c7c-3185-4ae4-af15-7deeba4a037c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.197443] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24a59c7c-3185-4ae4-af15-7deeba4a037c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.197592] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.197686] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.197747] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.197905] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.197998] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.198441] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24a59c7c-3185-4ae4-af15-7deeba4a037c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.203351] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e39d3b8-c430-4219-9295-992b699ce546 in Status: SUCCESS [ 829.203351] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e39d3b8-c430-4219-9295-992b699ce546 deletion is rescheduled due to dependency. [ 829.203351] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e39d3b8-c430-4219-9295-992b699ce546" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.203351] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.203351] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.203351] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.203879] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.203879] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.203879] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 is going to be updated. [ 829.204685] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.204794] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.204862] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.205033] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.205124] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.205208] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70738fbe-b41d-467c-86c7-92a8c5a2a723 is going to be updated. [ 829.206119] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.206223] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.206283] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.206426] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.206498] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.206578] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 372986d1-e1d1-4c79-a20b-8d90ef31aef2 is going to be updated. [ 829.237421] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.237421] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.237692] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.237759] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.237949] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.239742] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.239886] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.239886] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.240652] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.240652] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.242270] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.242440] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.242509] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.242803] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.242931] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.254012] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70738fbe-b41d-467c-86c7-92a8c5a2a723 in Status: IN_PROGRESS for 2s [ 829.256098] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 in Status: IN_PROGRESS for 2s [ 829.256098] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 372986d1-e1d1-4c79-a20b-8d90ef31aef2 in Status: IN_PROGRESS for 2s [ 829.703129] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.703457] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.703457] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.703610] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.703666] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.703831] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.703925] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.703992] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.704144] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.704237] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.704800] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24a59c7c-3185-4ae4-af15-7deeba4a037c is going to be updated. [ 829.736734] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.736958] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.737114] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.737487] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.739667] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.749114] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24a59c7c-3185-4ae4-af15-7deeba4a037c in Status: IN_PROGRESS for 2s [ 829.759831] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc in Status: SUCCESS [ 829.760186] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.159372] env[68328]: INFO networking_nsxv3.common.synchronization [req-47d3d361-6672-4604-922d-444ca92bfa04 req-0f1fcc1a-ed38-4588-8bde-9f54df073905 tempest-MultipleCreateTestJSON-885002055 tempest-MultipleCreateTestJSON-885002055-project-member] Enqueued Resource ID: 96047272-421b-4187-99a6-e18e4a01bfc9 with Priority: HIGHEST for action security_group_members [ 830.160354] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96047272-421b-4187-99a6-e18e4a01bfc9 with Priority: HIGHEST for action security_group_members [ 830.160728] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-96047272-421b-4187-99a6-e18e4a01bfc9 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.160803] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.160855] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.165073] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.165275] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.165387] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.165450] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.165622] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.166398] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.166398] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('96047272-421b-4187-99a6-e18e4a01bfc9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.225322] env[68328]: INFO networking_nsxv3.common.synchronization [req-c14ba3b5-7dad-4af5-a005-1656ffb34fe1 req-242174e6-d7f1-4fed-a123-a8b22cc820a4 tempest-MultipleCreateTestJSON-885002055 tempest-MultipleCreateTestJSON-885002055-project-member] Enqueued Resource ID: 96047272-421b-4187-99a6-e18e4a01bfc9 with Priority: HIGHEST for action security_group_members [ 830.225828] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96047272-421b-4187-99a6-e18e4a01bfc9 with Priority: HIGHEST for action security_group_members [ 830.226136] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-96047272-421b-4187-99a6-e18e4a01bfc9 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.226231] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.669379] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.669379] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.669606] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.669690] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.669720] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.670262] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.670389] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.670517] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.671243] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.671243] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.671243] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96047272-421b-4187-99a6-e18e4a01bfc9 is going to be updated. [ 830.701542] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.701739] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.701845] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.702203] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.702604] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.715913] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96047272-421b-4187-99a6-e18e4a01bfc9 in Status: IN_PROGRESS for 2s [ 831.080852] env[68328]: INFO networking_nsxv3.common.synchronization [req-958e634d-33a9-4f0f-9bbb-ac314d746fb8 req-8c666f35-0fe5-4b0f-97ea-9eda80680b8d tempest-ImagesTestJSON-69996350 tempest-ImagesTestJSON-69996350-project-member] Enqueued Resource ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 with Priority: HIGHEST for action security_group_members [ 831.082646] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 with Priority: HIGHEST for action security_group_members [ 831.082646] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-249b36cf-74ee-44d9-b2c9-d728a30d9a09 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.082646] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.082646] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.082646] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.082646] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.082646] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.083879] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.084088] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.084178] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.084278] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('249b36cf-74ee-44d9-b2c9-d728a30d9a09',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.269878] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70738fbe-b41d-467c-86c7-92a8c5a2a723 in Status: SUCCESS [ 831.271671] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70738fbe-b41d-467c-86c7-92a8c5a2a723" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.271671] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 in Status: SUCCESS [ 831.271671] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.271928] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 372986d1-e1d1-4c79-a20b-8d90ef31aef2 in Status: SUCCESS [ 831.275379] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-372986d1-e1d1-4c79-a20b-8d90ef31aef2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.275379] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70738fbe-b41d-467c-86c7-92a8c5a2a723" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.275379] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70738fbe-b41d-467c-86c7-92a8c5a2a723" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.275379] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.275379] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.275379] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.275379] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.275379] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.275379] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70738fbe-b41d-467c-86c7-92a8c5a2a723" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.275379] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('70738fbe-b41d-467c-86c7-92a8c5a2a723',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.275379] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.275379] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.275379] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.275379] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.275379] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.276012] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.276012] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.276012] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.276012] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.276718] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-372986d1-e1d1-4c79-a20b-8d90ef31aef2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.277184] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-372986d1-e1d1-4c79-a20b-8d90ef31aef2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.279952] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.280157] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.280223] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.280372] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.280450] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.280531] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-372986d1-e1d1-4c79-a20b-8d90ef31aef2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.280628] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('372986d1-e1d1-4c79-a20b-8d90ef31aef2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.281948] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70738fbe-b41d-467c-86c7-92a8c5a2a723" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.282121] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70738fbe-b41d-467c-86c7-92a8c5a2a723" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.282281] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.282442] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.282503] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.282642] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.282716] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.282797] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70738fbe-b41d-467c-86c7-92a8c5a2a723',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.283540] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.283708] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.284102] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.284235] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.284327] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.284494] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.285306] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.285438] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.286377] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-372986d1-e1d1-4c79-a20b-8d90ef31aef2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.286599] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-372986d1-e1d1-4c79-a20b-8d90ef31aef2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.286793] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.286958] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.287070] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.287204] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.287300] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.287398] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('372986d1-e1d1-4c79-a20b-8d90ef31aef2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.586896] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.588326] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.588519] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.588850] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.589064] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.589362] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.589708] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.589850] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.590166] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.590335] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.590509] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 is going to be updated. [ 831.617427] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.617427] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.617427] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.617427] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.617427] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.625874] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 in Status: IN_PROGRESS for 2s [ 831.759848] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24a59c7c-3185-4ae4-af15-7deeba4a037c in Status: SUCCESS [ 831.759848] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24a59c7c-3185-4ae4-af15-7deeba4a037c deletion is rescheduled due to dependency. [ 831.759848] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24a59c7c-3185-4ae4-af15-7deeba4a037c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.782623] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('70738fbe-b41d-467c-86c7-92a8c5a2a723',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.785083] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-870ec36b-ba1d-4422-a26d-1328f51f79e4 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.785247] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.788776] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.789539] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('372986d1-e1d1-4c79-a20b-8d90ef31aef2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.790883] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.791670] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.791779] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.792033] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.792164] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.792378] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.792513] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.792605] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.792789] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.792902] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.795710] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70738fbe-b41d-467c-86c7-92a8c5a2a723 is going to be updated. [ 831.796745] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.796852] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.796919] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.798342] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.798342] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.798342] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.798342] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.798342] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.798342] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.798342] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.798342] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 372986d1-e1d1-4c79-a20b-8d90ef31aef2 is going to be deleted. [ 831.801737] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-834 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.802019] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-834" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.802192] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-834" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.802458] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-834" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.802730] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.802919] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.803077] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.803328] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.803501] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.803817] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 831.803959] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 831.804116] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 831.804295] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 831.804610] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 831.804610] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 831.804911] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 831.824909] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 831.824909] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 831.825060] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 831.825211] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-834" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.825537] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-8ca8dbd2-198d-462d-9790-c6bb9ceb5d45 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.825720] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-8ca8dbd2-198d-462d-9790-c6bb9ceb5d45" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.825841] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-8ca8dbd2-198d-462d-9790-c6bb9ceb5d45" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.826228] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-8ca8dbd2-198d-462d-9790-c6bb9ceb5d45" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.826374] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ca8dbd2-198d-462d-9790-c6bb9ceb5d45',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.828708] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.828914] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.829030] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.829225] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.829384] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.837510] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.838461] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.838461] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.838461] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.838461] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.838461] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-372986d1-e1d1-4c79-a20b-8d90ef31aef2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.838981] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70738fbe-b41d-467c-86c7-92a8c5a2a723 in Status: IN_PROGRESS for 2s [ 832.286012] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 70738fbe-b41d-467c-86c7-92a8c5a2a723: rpc.has_security_group_logging(os_id): False [ 832.291902] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.300174] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 372986d1-e1d1-4c79-a20b-8d90ef31aef2: rpc.has_security_group_logging(os_id): False [ 832.303421] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.303618] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.303727] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.303970] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.304548] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.305312] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.305312] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.305312] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.305312] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.305312] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.305312] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70738fbe-b41d-467c-86c7-92a8c5a2a723 is going to be updated. [ 832.315832] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.316013] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.316142] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.316475] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.316606] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.316847] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.316983] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.317142] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.317335] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.317452] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.317559] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 372986d1-e1d1-4c79-a20b-8d90ef31aef2 is going to be created. [ 832.329542] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.329748] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.329874] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.330219] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.330369] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.330707] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 8ca8dbd2-198d-462d-9790-c6bb9ceb5d45 not found, creating... [ 832.330777] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.330928] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.331137] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.331379] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.331519] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.331800] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.331955] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.332086] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.332295] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.332633] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.332633] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 8ca8dbd2-198d-462d-9790-c6bb9ceb5d45 is going to be created. [ 832.339509] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/372986d1-e1d1-4c79-a20b-8d90ef31aef2], does not exist path=[/infra/domains/default/groups/372986d1-e1d1-4c79-a20b-8d90ef31aef2]."\n}' [ 832.339609] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 372986d1-e1d1-4c79-a20b-8d90ef31aef2 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/372986d1-e1d1-4c79-a20b-8d90ef31aef2 [ 832.339609] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 832.366447] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.366658] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.366786] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.367074] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.367305] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.367531] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-8ca8dbd2-198d-462d-9790-c6bb9ceb5d45" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.374718] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.374840] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.374907] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.375113] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.375247] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.389022] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.389022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.389022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.389022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.389022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.389022] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.389022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.389022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.389022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.389022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.389022] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.389022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.389022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.389022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.389022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.389767] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 372986d1-e1d1-4c79-a20b-8d90ef31aef2 is going to be created. [ 832.390815] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70738fbe-b41d-467c-86c7-92a8c5a2a723 in Status: IN_PROGRESS for 2s [ 832.410666] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/372986d1-e1d1-4c79-a20b-8d90ef31aef2], does not exist path=[/infra/domains/default/groups/372986d1-e1d1-4c79-a20b-8d90ef31aef2]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/372986d1-e1d1-4c79-a20b-8d90ef31aef2 [ 832.410818] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-372986d1-e1d1-4c79-a20b-8d90ef31aef2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.411466] env[68328]: Traceback (most recent call last): [ 832.411466] env[68328]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 832.411466] env[68328]: return func(*args, **kwargs) [ 832.411584] env[68328]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 832.411584] env[68328]: res.raise_for_status() [ 832.411584] env[68328]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 832.411584] env[68328]: raise HTTPError(http_error_msg, response=self) [ 832.411584] env[68328]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/372986d1-e1d1-4c79-a20b-8d90ef31aef2 [ 832.411584] env[68328]: During handling of the above exception, another exception occurred: [ 832.411584] env[68328]: Traceback (most recent call last): [ 832.411584] env[68328]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 832.411584] env[68328]: listener.cb(fileno) [ 832.411584] env[68328]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 832.411584] env[68328]: result = function(*args, **kwargs) [ 832.411584] env[68328]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 832.411584] env[68328]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 832.411584] env[68328]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 832.411584] env[68328]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 832.411584] env[68328]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 832.411584] env[68328]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 832.411584] env[68328]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 832.411584] env[68328]: res.raise_for_status() [ 832.411584] env[68328]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 832.411584] env[68328]: raise HTTPError(http_error_msg, response=self) [ 832.411584] env[68328]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/372986d1-e1d1-4c79-a20b-8d90ef31aef2 [ 832.411584] env[68328]: Removing descriptor: 19 [ 832.725497] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96047272-421b-4187-99a6-e18e4a01bfc9 in Status: SUCCESS [ 832.725627] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96047272-421b-4187-99a6-e18e4a01bfc9 deletion is rescheduled due to dependency. [ 832.725754] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.725918] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.726151] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.726334] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.726451] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.726510] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.726657] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.726737] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.726832] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('96047272-421b-4187-99a6-e18e4a01bfc9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.788033] env[68328]: INFO networking_nsxv3.common.synchronization [req-79ba8716-fad4-4f4e-9839-1df1c1e0efe6 req-4618c095-afe1-41f2-910c-ce512e14c4fe tempest-AttachInterfacesTestJSON-966841523 tempest-AttachInterfacesTestJSON-966841523-project-member] Enqueued Resource ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 with Priority: HIGHEST for action security_group_members [ 832.792519] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 with Priority: HIGHEST for action security_group_members [ 832.792908] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.792991] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.793049] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.793303] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.793455] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.793551] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.793612] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.793760] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.793842] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.793931] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('398e93bc-b7ea-4684-aa02-2e6ab22c1fe5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.795014] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.795014] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.795014] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.795190] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.795224] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.795301] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 is going to be updated. [ 832.824910] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.824910] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.824910] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.824910] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.824910] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.833122] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 in Status: IN_PROGRESS for 2s [ 833.210017] env[68328]: INFO networking_nsxv3.common.synchronization [req-958e634d-33a9-4f0f-9bbb-ac314d746fb8 req-cbf42cf0-f178-479c-b3ae-4a6327759820 service nova] Enqueued Resource ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 with Priority: HIGHEST for action security_group_rules [ 833.210017] env[68328]: INFO networking_nsxv3.common.synchronization [req-958e634d-33a9-4f0f-9bbb-ac314d746fb8 req-cbf42cf0-f178-479c-b3ae-4a6327759820 service nova] Enqueued Resource ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 with Priority: HIGHEST for action security_group_members [ 833.210017] env[68328]: INFO networking_nsxv3.common.synchronization [req-958e634d-33a9-4f0f-9bbb-ac314d746fb8 req-cbf42cf0-f178-479c-b3ae-4a6327759820 service nova] Enqueued Resource ID: 8ca8dbd2-198d-462d-9790-c6bb9ceb5d45 with Priority: HIGHEST for action port [ 833.210017] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 with Priority: HIGHEST for action security_group_rules [ 833.210017] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 with Priority: HIGHEST for action security_group_members [ 833.210017] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ca8dbd2-198d-462d-9790-c6bb9ceb5d45 with Priority: HIGHEST for action port [ 833.211177] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-249b36cf-74ee-44d9-b2c9-d728a30d9a09 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.211705] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.213273] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.213273] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.213273] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('249b36cf-74ee-44d9-b2c9-d728a30d9a09',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.213273] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-249b36cf-74ee-44d9-b2c9-d728a30d9a09 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.213273] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.214136] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ca8dbd2-198d-462d-9790-c6bb9ceb5d45 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.214370] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ca8dbd2-198d-462d-9790-c6bb9ceb5d45" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.214524] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ca8dbd2-198d-462d-9790-c6bb9ceb5d45" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.215220] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ca8dbd2-198d-462d-9790-c6bb9ceb5d45" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.216018] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ca8dbd2-198d-462d-9790-c6bb9ceb5d45',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.230143] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.230430] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.230934] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.230934] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.237795] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-615 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.238050] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-615" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.238924] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-615" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.238924] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-615" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.238924] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.238924] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.238924] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.239170] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.239639] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.239639] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 833.239639] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 833.239831] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 833.240088] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 833.240227] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 833.240354] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 833.240495] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 833.252911] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.253146] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.255484] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.255484] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.255484] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.255484] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.255484] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96047272-421b-4187-99a6-e18e4a01bfc9 is going to be updated. [ 833.256249] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 833.256571] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.016 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 833.256729] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 833.257036] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-615" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.257169] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-c5231529-6480-41a6-bc93-93a46eedda41 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.257322] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-c5231529-6480-41a6-bc93-93a46eedda41" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.257436] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-c5231529-6480-41a6-bc93-93a46eedda41" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.258044] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-c5231529-6480-41a6-bc93-93a46eedda41" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.258501] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5231529-6480-41a6-bc93-93a46eedda41',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.276458] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.276458] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.276458] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.277055] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.277055] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.285089] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96047272-421b-4187-99a6-e18e4a01bfc9 in Status: IN_PROGRESS for 2s [ 833.298812] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.298958] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.299023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.299239] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.299339] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.299883] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.299883] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.299883] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.300365] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.300365] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.300365] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 already deleted. [ 833.300365] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.636120] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 in Status: SUCCESS [ 833.636120] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 deletion is rescheduled due to dependency. [ 833.636120] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.636300] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.636438] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.636592] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.636727] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.636792] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.636948] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.637064] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.637168] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('249b36cf-74ee-44d9-b2c9-d728a30d9a09',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.666663] env[68328]: INFO networking_nsxv3.common.synchronization [None req-f313e010-3350-495d-a087-9faf8388c589 None None] Enqueued Resource ID: f5a65682-2b68-415f-ab18-2db73f3fa1da with Priority: HIGHEST for action port [ 833.666663] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5a65682-2b68-415f-ab18-2db73f3fa1da with Priority: HIGHEST for action port [ 833.666663] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-f5a65682-2b68-415f-ab18-2db73f3fa1da taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.666663] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f5a65682-2b68-415f-ab18-2db73f3fa1da" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.666663] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f5a65682-2b68-415f-ab18-2db73f3fa1da" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.666663] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f5a65682-2b68-415f-ab18-2db73f3fa1da" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.666663] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5a65682-2b68-415f-ab18-2db73f3fa1da',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.719842] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-249b36cf-74ee-44d9-b2c9-d728a30d9a09 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.719842] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.719842] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8ca8dbd2-198d-462d-9790-c6bb9ceb5d45 with status ACTIVE [ 833.719842] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.719842] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.719842] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.719842] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.719842] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.720294] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.720294] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.720294] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.720608] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.720608] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.721334] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.721334] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.721456] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.721598] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.721645] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.721901] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8ca8dbd2-198d-462d-9790-c6bb9ceb5d45 is going to be updated. [ 833.741901] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.742088] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.742151] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.742411] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.747375] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.747375] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ca8dbd2-198d-462d-9790-c6bb9ceb5d45" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.768631] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.768631] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.768631] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.768796] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.769111] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.769111] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port c5231529-6480-41a6-bc93-93a46eedda41 not found, creating... [ 833.769396] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.769571] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.769733] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.769855] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.769996] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.772232] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.772232] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.772232] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.772232] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.772232] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.772232] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: c5231529-6480-41a6-bc93-93a46eedda41 is going to be created. [ 833.788538] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.789233] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.789233] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.789233] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.789441] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.789690] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-c5231529-6480-41a6-bc93-93a46eedda41" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.863697] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70738fbe-b41d-467c-86c7-92a8c5a2a723 in Status: SUCCESS [ 833.863875] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70738fbe-b41d-467c-86c7-92a8c5a2a723 deletion is rescheduled due to dependency. [ 833.864020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70738fbe-b41d-467c-86c7-92a8c5a2a723" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.140178] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('249b36cf-74ee-44d9-b2c9-d728a30d9a09',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.170682] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f5a65682-2b68-415f-ab18-2db73f3fa1da [ 834.170682] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.170682] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.170682] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.170682] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.170682] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.170682] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f5a65682-2b68-415f-ab18-2db73f3fa1da already deleted. [ 834.170682] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f5a65682-2b68-415f-ab18-2db73f3fa1da" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.405247] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70738fbe-b41d-467c-86c7-92a8c5a2a723 in Status: SUCCESS [ 834.406052] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70738fbe-b41d-467c-86c7-92a8c5a2a723" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.629627] env[68328]: INFO networking_nsxv3.common.synchronization [req-79ba8716-fad4-4f4e-9839-1df1c1e0efe6 req-660f60a7-4e4d-4301-bd05-015ee3fe6c54 service nova] Enqueued Resource ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 with Priority: HIGHEST for action security_group_rules [ 834.629833] env[68328]: INFO networking_nsxv3.common.synchronization [req-79ba8716-fad4-4f4e-9839-1df1c1e0efe6 req-660f60a7-4e4d-4301-bd05-015ee3fe6c54 service nova] Enqueued Resource ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 with Priority: HIGHEST for action security_group_members [ 834.630173] env[68328]: INFO networking_nsxv3.common.synchronization [req-79ba8716-fad4-4f4e-9839-1df1c1e0efe6 req-660f60a7-4e4d-4301-bd05-015ee3fe6c54 service nova] Enqueued Resource ID: c5231529-6480-41a6-bc93-93a46eedda41 with Priority: HIGHEST for action port [ 834.630448] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 with Priority: HIGHEST for action security_group_rules [ 834.630612] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 with Priority: HIGHEST for action security_group_members [ 834.630732] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5231529-6480-41a6-bc93-93a46eedda41 with Priority: HIGHEST for action port [ 834.632244] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.632244] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.632244] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.632691] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.632691] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('398e93bc-b7ea-4684-aa02-2e6ab22c1fe5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.633381] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.633492] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.633558] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.633735] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.633891] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.633986] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.634067] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.634209] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.634295] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.634388] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('398e93bc-b7ea-4684-aa02-2e6ab22c1fe5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.635153] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5231529-6480-41a6-bc93-93a46eedda41 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.635250] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5231529-6480-41a6-bc93-93a46eedda41" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.635317] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5231529-6480-41a6-bc93-93a46eedda41" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.635464] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5231529-6480-41a6-bc93-93a46eedda41" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.635537] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5231529-6480-41a6-bc93-93a46eedda41',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.642124] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('249b36cf-74ee-44d9-b2c9-d728a30d9a09',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.842187] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 in Status: SUCCESS [ 834.842463] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.842631] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.842820] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.843027] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.843232] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.843296] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.843489] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.843576] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.843681] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.843841] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-870ec36b-ba1d-4422-a26d-1328f51f79e4 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.843961] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.844105] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.844175] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.844336] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.844429] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.844487] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.844643] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.844717] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.844796] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.844884] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.140758] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.140929] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.141182] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c5231529-6480-41a6-bc93-93a46eedda41 with status ACTIVE [ 835.141389] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.141501] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.141564] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.141768] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.141857] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.142944] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.142944] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.142944] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.142944] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.142944] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.142944] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.142944] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.142944] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.142944] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.142944] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.143524] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c5231529-6480-41a6-bc93-93a46eedda41 is going to be updated. [ 835.144446] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('398e93bc-b7ea-4684-aa02-2e6ab22c1fe5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.146408] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.146408] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.146408] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.146408] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.146408] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.146637] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 is going to be updated. [ 835.169253] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.169383] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.169439] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.169649] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.169775] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.169968] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5231529-6480-41a6-bc93-93a46eedda41" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.172563] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.172679] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.172744] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.172966] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.173126] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.181617] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 in Status: IN_PROGRESS for 2s [ 835.218075] env[68328]: INFO networking_nsxv3.common.synchronization [None req-a42643c6-1a01-42b8-b9af-bf4823218671 tempest-AttachVolumeTestJSON-972540760 tempest-AttachVolumeTestJSON-972540760-project-member] Enqueued Resource ID: e50e8525-9eb2-4aff-9a46-c4c1621d14db with Priority: HIGHEST for action security_group_rules [ 835.218515] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e50e8525-9eb2-4aff-9a46-c4c1621d14db with Priority: HIGHEST for action security_group_rules [ 835.218823] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e50e8525-9eb2-4aff-9a46-c4c1621d14db taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.218944] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e50e8525-9eb2-4aff-9a46-c4c1621d14db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.219132] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e50e8525-9eb2-4aff-9a46-c4c1621d14db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.219403] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e50e8525-9eb2-4aff-9a46-c4c1621d14db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.219487] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e50e8525-9eb2-4aff-9a46-c4c1621d14db',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.294788] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96047272-421b-4187-99a6-e18e4a01bfc9 in Status: SUCCESS [ 835.296304] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96047272-421b-4187-99a6-e18e4a01bfc9 deletion is rescheduled due to dependency. [ 835.296304] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.309303] env[68328]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-038e1d26-3718-4954-be87-7b533345599d None None] NSXv3 Agent Agent loop - iteration:0 completed [ 835.309303] env[68328]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-038e1d26-3718-4954-be87-7b533345599d None None] NSXv3 Agent Agent loop - iteration:1 started [ 835.309836] env[68328]: INFO networking_nsxv3.common.synchronization [None req-cb482d2e-ff14-4570-a7ea-10746f306795 tempest-AttachVolumeTestJSON-972540760 tempest-AttachVolumeTestJSON-972540760-project-member] Enqueued Resource ID: e50e8525-9eb2-4aff-9a46-c4c1621d14db with Priority: HIGHEST for action security_group_rules [ 835.310446] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e50e8525-9eb2-4aff-9a46-c4c1621d14db with Priority: HIGHEST for action security_group_rules [ 835.311145] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e50e8525-9eb2-4aff-9a46-c4c1621d14db taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.311318] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e50e8525-9eb2-4aff-9a46-c4c1621d14db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.351898] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 870ec36b-ba1d-4422-a26d-1328f51f79e4: rpc.has_security_group_logging(os_id): False [ 835.372427] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.372427] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.372427] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.372427] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.389199] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.389503] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.389621] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.389706] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.389887] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.389968] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.390198] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.390956] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.390956] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.390956] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.390956] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.390956] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.390956] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.390956] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.391288] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.391288] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.391288] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 is going to be updated. [ 835.446560] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.446706] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.446790] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.447015] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.447143] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.462486] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 in Status: IN_PROGRESS for 2s [ 835.653401] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('398e93bc-b7ea-4684-aa02-2e6ab22c1fe5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.737755] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.737925] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.737975] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.738305] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.738399] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.738514] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e50e8525-9eb2-4aff-9a46-c4c1621d14db already deleted. [ 835.738598] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e50e8525-9eb2-4aff-9a46-c4c1621d14db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.738753] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e50e8525-9eb2-4aff-9a46-c4c1621d14db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.738913] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e50e8525-9eb2-4aff-9a46-c4c1621d14db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.739009] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e50e8525-9eb2-4aff-9a46-c4c1621d14db',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.950502] env[68328]: INFO networking_nsxv3.common.synchronization [None req-387690bc-38e4-40fc-9f5f-6012a3531a77 None None] Enqueued Resource ID: 92fd4e49-0181-4659-b3f5-a994021cfc18 with Priority: HIGHEST for action port [ 835.951090] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92fd4e49-0181-4659-b3f5-a994021cfc18 with Priority: HIGHEST for action port [ 835.951427] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-92fd4e49-0181-4659-b3f5-a994021cfc18 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.951570] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92fd4e49-0181-4659-b3f5-a994021cfc18" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.951653] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92fd4e49-0181-4659-b3f5-a994021cfc18" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.952023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92fd4e49-0181-4659-b3f5-a994021cfc18" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.952023] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92fd4e49-0181-4659-b3f5-a994021cfc18',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.157579] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.157579] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.157579] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.157579] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.157579] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.157579] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 is going to be created. [ 836.218246] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.218246] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.218246] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.218246] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.218246] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.229041] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 in Status: UNINITIALIZED for 2s [ 836.259294] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.259294] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.259294] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.259294] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.259294] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.259294] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e50e8525-9eb2-4aff-9a46-c4c1621d14db already deleted. [ 836.259294] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e50e8525-9eb2-4aff-9a46-c4c1621d14db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.303441] env[68328]: INFO networking_nsxv3.common.synchronization [None req-7243be0b-741a-4a14-bc4a-196a34d40417 None None] Enqueued Resource ID: cf40190b-ba81-46ce-b7d9-901386ed0001 with Priority: HIGHEST for action port [ 836.303441] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf40190b-ba81-46ce-b7d9-901386ed0001 with Priority: HIGHEST for action port [ 836.303441] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf40190b-ba81-46ce-b7d9-901386ed0001 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.303441] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf40190b-ba81-46ce-b7d9-901386ed0001" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.303441] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf40190b-ba81-46ce-b7d9-901386ed0001" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.303441] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf40190b-ba81-46ce-b7d9-901386ed0001" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.305887] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf40190b-ba81-46ce-b7d9-901386ed0001',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.454664] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 92fd4e49-0181-4659-b3f5-a994021cfc18 [ 836.454909] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.455062] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.455136] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.455558] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.455778] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.455778] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:92fd4e49-0181-4659-b3f5-a994021cfc18 already deleted. [ 836.455870] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92fd4e49-0181-4659-b3f5-a994021cfc18" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.707876] env[68328]: INFO networking_nsxv3.common.synchronization [req-c54c7817-ccc6-4419-ac7e-928629918934 req-039c4dfb-30c2-4f11-bd10-75c4b8e2ba5d tempest-ServersWithSpecificFlavorTestJSON-2033217338 tempest-ServersWithSpecificFlavorTestJSON-2033217338-project-member] Enqueued Resource ID: 3e399462-679e-43d6-8b03-2876938fc726 with Priority: HIGHEST for action security_group_members [ 836.708772] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e399462-679e-43d6-8b03-2876938fc726 with Priority: HIGHEST for action security_group_members [ 836.712479] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e399462-679e-43d6-8b03-2876938fc726 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.716300] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.716300] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.716300] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.716300] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.716300] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.716300] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.716300] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.716300] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.716300] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e399462-679e-43d6-8b03-2876938fc726',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.808275] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cf40190b-ba81-46ce-b7d9-901386ed0001 [ 836.808275] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.808275] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.808275] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.808275] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.808275] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.808275] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cf40190b-ba81-46ce-b7d9-901386ed0001 already deleted. [ 836.808275] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf40190b-ba81-46ce-b7d9-901386ed0001" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.195215] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 in Status: SUCCESS [ 837.195594] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.195594] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.196926] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.196926] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.196926] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.196926] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.196926] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.196926] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.196926] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.196926] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('249b36cf-74ee-44d9-b2c9-d728a30d9a09',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.217299] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.217426] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.217495] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.217701] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.236531] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.236780] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.236904] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.236964] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.238020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.238020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.238020] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e399462-679e-43d6-8b03-2876938fc726 is going to be updated. [ 837.260949] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.260949] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.260949] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.260949] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.260949] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.271524] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e399462-679e-43d6-8b03-2876938fc726 in Status: IN_PROGRESS for 2s [ 837.440291] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-657 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.440497] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-657" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.440622] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-657" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.441062] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-657" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.441384] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.441551] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.441670] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.441885] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.442050] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.442270] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 837.442384] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 837.442495] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 837.442602] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 837.442710] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 837.442814] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 837.442951] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 837.460696] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 837.460858] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 837.460995] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 837.461211] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-657" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.461545] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-4325152e-17e0-4302-a257-d3c33cb93085 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.461714] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-4325152e-17e0-4302-a257-d3c33cb93085" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.461871] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-4325152e-17e0-4302-a257-d3c33cb93085" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.462192] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-4325152e-17e0-4302-a257-d3c33cb93085" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.462297] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4325152e-17e0-4302-a257-d3c33cb93085',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.479706] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 in Status: SUCCESS [ 837.479926] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.700067] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-249b36cf-74ee-44d9-b2c9-d728a30d9a09 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.700281] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.700376] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.700646] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.700873] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.701247] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.701247] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.702631] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.702754] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.703177] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.705877] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-249b36cf-74ee-44d9-b2c9-d728a30d9a09 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.705877] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.705877] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.705877] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.705877] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.705877] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.705877] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.705877] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.705877] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.705877] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.705877] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('249b36cf-74ee-44d9-b2c9-d728a30d9a09',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.968908] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.969113] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.969289] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.969504] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.969660] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.971347] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 4325152e-17e0-4302-a257-d3c33cb93085 not found, creating... [ 837.971347] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.971347] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.971347] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.971347] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.971347] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.971347] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.971347] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.971834] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.971834] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.971834] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.971990] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 4325152e-17e0-4302-a257-d3c33cb93085 is going to be created. [ 837.991286] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.991529] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.991619] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.991900] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.992144] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.992499] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-4325152e-17e0-4302-a257-d3c33cb93085" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.209297] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 249b36cf-74ee-44d9-b2c9-d728a30d9a09: rpc.has_security_group_logging(os_id): False [ 838.234350] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.234487] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.235270] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.235270] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.241969] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 in Status: SUCCESS [ 838.242234] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.242708] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.243183] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.243183] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.243333] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.243333] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.243434] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.243514] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.243597] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.243683] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('398e93bc-b7ea-4684-aa02-2e6ab22c1fe5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.256148] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.256500] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.256948] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.256948] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.257099] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.257099] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.257282] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.257388] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.257454] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.257608] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.257685] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.257875] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.257968] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.259113] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.259306] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.259393] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.259486] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 is going to be updated. [ 838.297483] env[68328]: INFO networking_nsxv3.common.synchronization [None req-d9499234-ff3d-4f73-9244-b3522d1abaad None None] Enqueued Resource ID: 8ae72157-fab7-4f13-86f3-6cb6f540cf80 with Priority: HIGHEST for action port [ 838.297856] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ae72157-fab7-4f13-86f3-6cb6f540cf80 with Priority: HIGHEST for action port [ 838.298391] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ae72157-fab7-4f13-86f3-6cb6f540cf80 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.298554] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ae72157-fab7-4f13-86f3-6cb6f540cf80" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.298717] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ae72157-fab7-4f13-86f3-6cb6f540cf80" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.299648] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ae72157-fab7-4f13-86f3-6cb6f540cf80" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.299792] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ae72157-fab7-4f13-86f3-6cb6f540cf80',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.331024] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.331024] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.331024] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.331024] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.331024] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.348474] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 in Status: IN_PROGRESS for 2s [ 838.749495] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.752523] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.752523] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.752523] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.752523] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.752523] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.752523] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.752523] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.752523] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.752523] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.752523] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.752523] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.752523] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.752523] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.752523] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.752523] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.752523] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.752523] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.752523] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.753139] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.753139] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('398e93bc-b7ea-4684-aa02-2e6ab22c1fe5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.804014] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8ae72157-fab7-4f13-86f3-6cb6f540cf80 [ 838.804258] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.805235] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.805235] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.805235] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.805235] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.805235] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8ae72157-fab7-4f13-86f3-6cb6f540cf80 already deleted. [ 838.805235] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ae72157-fab7-4f13-86f3-6cb6f540cf80" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.812634] env[68328]: INFO networking_nsxv3.common.synchronization [None req-2aedfd6b-fce3-4e0a-ba19-eff8f64df6e5 tempest-AttachVolumeShelveTestJSON-1223620556 tempest-AttachVolumeShelveTestJSON-1223620556-project-member] Enqueued Resource ID: 551b86cb-6c17-4238-9ac7-89fd77e1e91b with Priority: HIGHEST for action security_group_rules [ 838.813388] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 551b86cb-6c17-4238-9ac7-89fd77e1e91b with Priority: HIGHEST for action security_group_rules [ 838.817019] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-551b86cb-6c17-4238-9ac7-89fd77e1e91b taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.817019] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-551b86cb-6c17-4238-9ac7-89fd77e1e91b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.817019] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-551b86cb-6c17-4238-9ac7-89fd77e1e91b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.817019] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-551b86cb-6c17-4238-9ac7-89fd77e1e91b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.817019] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('551b86cb-6c17-4238-9ac7-89fd77e1e91b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.821080] env[68328]: INFO networking_nsxv3.common.synchronization [req-c54c7817-ccc6-4419-ac7e-928629918934 req-8722de15-06cf-47ba-9492-a012e7414822 service nova] Enqueued Resource ID: 3e399462-679e-43d6-8b03-2876938fc726 with Priority: HIGHEST for action security_group_rules [ 838.821253] env[68328]: INFO networking_nsxv3.common.synchronization [req-c54c7817-ccc6-4419-ac7e-928629918934 req-8722de15-06cf-47ba-9492-a012e7414822 service nova] Enqueued Resource ID: 3e399462-679e-43d6-8b03-2876938fc726 with Priority: HIGHEST for action security_group_members [ 838.821410] env[68328]: INFO networking_nsxv3.common.synchronization [req-c54c7817-ccc6-4419-ac7e-928629918934 req-8722de15-06cf-47ba-9492-a012e7414822 service nova] Enqueued Resource ID: 4325152e-17e0-4302-a257-d3c33cb93085 with Priority: HIGHEST for action port [ 838.821627] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e399462-679e-43d6-8b03-2876938fc726 with Priority: HIGHEST for action security_group_rules [ 838.821747] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e399462-679e-43d6-8b03-2876938fc726 with Priority: HIGHEST for action security_group_members [ 838.821837] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4325152e-17e0-4302-a257-d3c33cb93085 with Priority: HIGHEST for action port [ 838.822339] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e399462-679e-43d6-8b03-2876938fc726 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.822444] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.822513] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.822779] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.822779] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e399462-679e-43d6-8b03-2876938fc726',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.823860] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e399462-679e-43d6-8b03-2876938fc726 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.824012] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.824250] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-4325152e-17e0-4302-a257-d3c33cb93085 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.824390] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4325152e-17e0-4302-a257-d3c33cb93085" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.824482] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4325152e-17e0-4302-a257-d3c33cb93085" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.824725] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4325152e-17e0-4302-a257-d3c33cb93085" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.824838] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4325152e-17e0-4302-a257-d3c33cb93085',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.915864] env[68328]: INFO networking_nsxv3.common.synchronization [None req-998c020a-5c4e-4ff1-9357-a886a8785761 tempest-AttachVolumeShelveTestJSON-1223620556 tempest-AttachVolumeShelveTestJSON-1223620556-project-member] Enqueued Resource ID: 551b86cb-6c17-4238-9ac7-89fd77e1e91b with Priority: HIGHEST for action security_group_rules [ 838.916512] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 551b86cb-6c17-4238-9ac7-89fd77e1e91b with Priority: HIGHEST for action security_group_rules [ 838.916748] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-551b86cb-6c17-4238-9ac7-89fd77e1e91b taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.916851] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-551b86cb-6c17-4238-9ac7-89fd77e1e91b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.259724] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5: rpc.has_security_group_logging(os_id): False [ 839.276664] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.277167] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.277167] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.277274] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.277308] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.277559] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.277721] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.277721] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.277876] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.277988] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.278174] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.279194] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.279194] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.279194] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.279194] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.279194] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.279194] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.279194] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.279194] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.279194] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.279194] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 is going to be created. [ 839.280806] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e399462-679e-43d6-8b03-2876938fc726 in Status: SUCCESS [ 839.280939] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e399462-679e-43d6-8b03-2876938fc726 deletion is rescheduled due to dependency. [ 839.281047] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.281606] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.282295] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.282480] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.282587] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.282652] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.282799] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.282878] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.282971] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e399462-679e-43d6-8b03-2876938fc726',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.326810] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e399462-679e-43d6-8b03-2876938fc726 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.327172] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.327463] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4325152e-17e0-4302-a257-d3c33cb93085 with status ACTIVE [ 839.327762] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.327971] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.328152] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.328449] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.328621] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.328880] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.329097] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.329231] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.329462] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.329619] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.329912] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.330125] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.330281] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.330470] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.330614] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.330772] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4325152e-17e0-4302-a257-d3c33cb93085 is going to be updated. [ 839.333373] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.333552] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.333587] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.333913] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.334202] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.336621] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.336911] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.337147] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.337299] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.337443] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.337598] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 551b86cb-6c17-4238-9ac7-89fd77e1e91b already deleted. [ 839.337735] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-551b86cb-6c17-4238-9ac7-89fd77e1e91b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.338753] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-551b86cb-6c17-4238-9ac7-89fd77e1e91b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.339019] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-551b86cb-6c17-4238-9ac7-89fd77e1e91b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.339277] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('551b86cb-6c17-4238-9ac7-89fd77e1e91b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.352213] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 in Status: IN_PROGRESS for 2s [ 839.357010] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.357165] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.362081] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.362416] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.362585] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.362790] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4325152e-17e0-4302-a257-d3c33cb93085" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.785096] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e399462-679e-43d6-8b03-2876938fc726',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.860222] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.860389] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.860458] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.860714] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.860783] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.861517] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 551b86cb-6c17-4238-9ac7-89fd77e1e91b already deleted. [ 839.861517] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-551b86cb-6c17-4238-9ac7-89fd77e1e91b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.289053] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e399462-679e-43d6-8b03-2876938fc726',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.361247] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 in Status: SUCCESS [ 840.361490] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.793640] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.793804] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.793873] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.794154] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.794257] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.798093] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e399462-679e-43d6-8b03-2876938fc726 is going to be updated. [ 840.819103] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.819364] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.819364] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.819500] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.819644] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.827484] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e399462-679e-43d6-8b03-2876938fc726 in Status: IN_PROGRESS for 2s [ 841.268299] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.268539] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.268539] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.268727] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.268837] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.362333] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 in Status: SUCCESS [ 841.363703] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.720568] env[68328]: INFO networking_nsxv3.common.synchronization [req-a37fd7ef-4d7f-4bc9-9c9b-f503de0180fa req-2a9f03c5-97f5-4ff4-b415-339be018ca29 tempest-ListServersNegativeTestJSON-482599207 tempest-ListServersNegativeTestJSON-482599207-project-member] Enqueued Resource ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 with Priority: HIGHEST for action security_group_members [ 841.721152] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 with Priority: HIGHEST for action security_group_members [ 841.721476] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bbd48a8-069c-43ef-b15c-47d19b8c7798 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.721593] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.721658] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.722748] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.722916] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.723132] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.723132] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.724280] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.724280] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.724417] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4bbd48a8-069c-43ef-b15c-47d19b8c7798',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.774380] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.209516] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-424 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.209771] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-424" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.209836] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-424" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.210240] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-424" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.210555] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.210785] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.210911] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.211208] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.211600] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.211965] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 842.212111] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 842.212229] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 842.212343] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 842.213041] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 842.213041] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 842.213041] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 842.226393] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.226545] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.226545] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.227621] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.227621] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.227621] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.227621] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.227621] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.227856] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.227856] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.227923] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 already deleted. [ 842.227972] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.233244] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 842.233470] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 842.233751] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 842.233871] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-424" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.234149] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-108a6b61-947f-4dab-8fe2-39fd27ee36db taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.234458] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-108a6b61-947f-4dab-8fe2-39fd27ee36db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.235176] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-108a6b61-947f-4dab-8fe2-39fd27ee36db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.235176] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-108a6b61-947f-4dab-8fe2-39fd27ee36db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.235176] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('108a6b61-947f-4dab-8fe2-39fd27ee36db',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.276510] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.738765] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.739187] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.739187] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.739475] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.739628] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.739789] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 108a6b61-947f-4dab-8fe2-39fd27ee36db not found, creating... [ 842.740074] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.740339] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.740461] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.740688] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.740825] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.741559] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.741751] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.741938] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.742243] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.742390] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.742541] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 108a6b61-947f-4dab-8fe2-39fd27ee36db is going to be created. [ 842.765068] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.765300] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.765427] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.765721] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.765916] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.766163] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-108a6b61-947f-4dab-8fe2-39fd27ee36db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.781122] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 842.781259] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 842.842852] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e399462-679e-43d6-8b03-2876938fc726 in Status: SUCCESS [ 842.842852] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.842852] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.845994] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.846327] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.846566] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.846655] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.846814] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.846893] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.847344] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.847344] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3e399462-679e-43d6-8b03-2876938fc726',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.351013] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3e399462-679e-43d6-8b03-2876938fc726',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.569020] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.569020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.569020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.569020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.589794] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 843.591066] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.594094] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 843.620920] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.621457] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.621667] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.622028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.628539] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.629212] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 843.629845] env[68328]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=68328) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 843.630100] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 843.667124] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.667124] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.667124] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.667124] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.667124] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.667124] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 843.727022] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.727022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.727022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.727022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.727022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.727022] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 843.792645] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.792962] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.792962] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.793095] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.793372] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.793522] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:35. [ 843.793611] env[68328]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'ccbebeb4-60d7-4344-b96e-b9dfdeae14b1', '55f209f1-d8fe-4d5e-a886-797753b1b3c1', '870ec36b-ba1d-4422-a26d-1328f51f79e4', '249b36cf-74ee-44d9-b2c9-d728a30d9a09', '96047272-421b-4187-99a6-e18e4a01bfc9', '8f95f28e-3c21-415e-9067-7aef8eff10d3', '14cff10c-171f-4bbf-8531-6de5c6c7cc48', '3e399462-679e-43d6-8b03-2876938fc726', 'e6de510a-9045-41b5-b9c0-0c2740830426', '76f74d16-9031-4472-a81b-f9ada0520a34', '61fb3384-8e34-4731-a436-48440a87fd65', '398e93bc-b7ea-4684-aa02-2e6ab22c1fe5', '02ce0770-2d9f-451b-8bc9-6982e5dbf513', 'b95bc2dc-a214-45b1-8103-2bccad318c7b', 'd160efa7-0312-433f-b94f-cf7e99e24473', 'b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed', 'ba6f8661-b38c-4d97-a1c5-4a0e33e341bc', 'f302de28-ce4b-4460-9ba9-d832cf4c957e', '24a59c7c-3185-4ae4-af15-7deeba4a037c', 'c8026099-4b7a-433d-98f2-b33d3f0a6907', '57b7bbe5-8e54-4d67-b8c6-8cfc418f7042', 'f0811b65-cde4-4246-a2e0-5bbd90921f5b', 'c897dadb-95bc-4de7-a117-d38870fbace8', 'b3fc1540-17fb-42c4-99d2-880ae35db079', '8024e0cc-9eaa-4282-b00c-9e9b1de030e2', '2158d2f5-a6e7-415a-a8b1-6f8353f45cb8', '3826a056-9a94-48ea-97d8-49b840d3fb63', '70738fbe-b41d-467c-86c7-92a8c5a2a723', '078ed1cc-5f72-48f4-8e16-b1d53057c32e', '72ca69cd-fcd9-4815-b331-9858d9cfad42', '6e39d3b8-c430-4219-9295-992b699ce546', '8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b', 'b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38', '7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63', '55dff300-131a-42f9-920d-f2b5a3b91449'} {{(pid=68328) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 843.793692] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 843.797567] env[68328]: INFO networking_nsxv3.common.synchronization [req-a37fd7ef-4d7f-4bc9-9c9b-f503de0180fa req-7cbd9f3c-5f05-43d6-b1a4-4db22afb2bbc service nova] Enqueued Resource ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 with Priority: HIGHEST for action security_group_rules [ 843.798285] env[68328]: INFO networking_nsxv3.common.synchronization [req-a37fd7ef-4d7f-4bc9-9c9b-f503de0180fa req-7cbd9f3c-5f05-43d6-b1a4-4db22afb2bbc service nova] Enqueued Resource ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 with Priority: HIGHEST for action security_group_members [ 843.798285] env[68328]: INFO networking_nsxv3.common.synchronization [req-a37fd7ef-4d7f-4bc9-9c9b-f503de0180fa req-7cbd9f3c-5f05-43d6-b1a4-4db22afb2bbc service nova] Enqueued Resource ID: 108a6b61-947f-4dab-8fe2-39fd27ee36db with Priority: HIGHEST for action port [ 843.798609] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 with Priority: HIGHEST for action security_group_rules [ 843.798609] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 with Priority: HIGHEST for action security_group_members [ 843.798609] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 108a6b61-947f-4dab-8fe2-39fd27ee36db with Priority: HIGHEST for action port [ 843.798935] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4bbd48a8-069c-43ef-b15c-47d19b8c7798 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.799017] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.799017] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.800406] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.800406] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4bbd48a8-069c-43ef-b15c-47d19b8c7798',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.800406] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bbd48a8-069c-43ef-b15c-47d19b8c7798 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.800703] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.800703] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.800703] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.800948] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.800948] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.801065] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.801122] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.801201] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.801285] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4bbd48a8-069c-43ef-b15c-47d19b8c7798',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.802146] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-108a6b61-947f-4dab-8fe2-39fd27ee36db taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.802258] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-108a6b61-947f-4dab-8fe2-39fd27ee36db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.802306] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-108a6b61-947f-4dab-8fe2-39fd27ee36db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.802468] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-108a6b61-947f-4dab-8fe2-39fd27ee36db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.802535] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('108a6b61-947f-4dab-8fe2-39fd27ee36db',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.814132] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.814654] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.814741] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.814964] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.815067] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.815210] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 843.815283] env[68328]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=68328) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 843.815352] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 843.852401] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3e399462-679e-43d6-8b03-2876938fc726: rpc.has_security_group_logging(os_id): False [ 843.862196] env[68328]: INFO networking_nsxv3.common.synchronization [req-2d9c9731-f6b9-46fc-bbb1-dfb322089f46 req-cb9159d9-6ea3-4136-8716-3c7b94e5bb09 tempest-ListImageFiltersTestJSON-876538757 tempest-ListImageFiltersTestJSON-876538757-project-member] Enqueued Resource ID: d160efa7-0312-433f-b94f-cf7e99e24473 with Priority: HIGHEST for action security_group_members [ 843.862462] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d160efa7-0312-433f-b94f-cf7e99e24473 with Priority: HIGHEST for action security_group_members [ 843.863035] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-d160efa7-0312-433f-b94f-cf7e99e24473 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.863157] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.863226] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.863420] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.863567] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.863659] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.863717] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.863853] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.863933] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.865254] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d160efa7-0312-433f-b94f-cf7e99e24473',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.868916] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.869044] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.869115] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.869309] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.888162] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.888461] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.888598] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.888636] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.888820] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.888901] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.888992] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e399462-679e-43d6-8b03-2876938fc726 is going to be updated. [ 843.905903] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.905903] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.905903] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.905903] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.906672] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.906672] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 843.906672] env[68328]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=68328) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 843.906672] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 843.906672] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 843.906672] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/35 resources of Type:Security Group Rules [ 843.906672] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 with Priority: HIGH for action security_group_rules [ 843.906672] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 with Priority: HIGH for action security_group_rules [ 843.906672] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 with Priority: HIGH for action security_group_rules [ 843.908771] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 with Priority: HIGH for action security_group_rules [ 843.908771] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 96047272-421b-4187-99a6-e18e4a01bfc9 with Priority: HIGH for action security_group_rules [ 843.908771] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8f95f28e-3c21-415e-9067-7aef8eff10d3 with Priority: HIGH for action security_group_rules [ 843.908771] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 14cff10c-171f-4bbf-8531-6de5c6c7cc48 with Priority: HIGH for action security_group_rules [ 843.908771] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3e399462-679e-43d6-8b03-2876938fc726 with Priority: HIGH for action security_group_rules [ 843.908771] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e6de510a-9045-41b5-b9c0-0c2740830426 with Priority: HIGH for action security_group_rules [ 843.908771] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 76f74d16-9031-4472-a81b-f9ada0520a34 with Priority: HIGH for action security_group_rules [ 843.908771] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 61fb3384-8e34-4731-a436-48440a87fd65 with Priority: HIGH for action security_group_rules [ 843.908771] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 with Priority: HIGH for action security_group_rules [ 843.908771] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 02ce0770-2d9f-451b-8bc9-6982e5dbf513 with Priority: HIGH for action security_group_rules [ 843.908771] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b95bc2dc-a214-45b1-8103-2bccad318c7b with Priority: HIGH for action security_group_rules [ 843.908771] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d160efa7-0312-433f-b94f-cf7e99e24473 with Priority: HIGH for action security_group_rules [ 843.908771] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed with Priority: HIGH for action security_group_rules [ 843.908771] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc with Priority: HIGH for action security_group_rules [ 843.908771] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f302de28-ce4b-4460-9ba9-d832cf4c957e with Priority: HIGH for action security_group_rules [ 843.908771] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 24a59c7c-3185-4ae4-af15-7deeba4a037c with Priority: HIGH for action security_group_rules [ 843.908771] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c8026099-4b7a-433d-98f2-b33d3f0a6907 with Priority: HIGH for action security_group_rules [ 843.908771] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.940484] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.940640] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.940759] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.940924] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.941087] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.951455] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e399462-679e-43d6-8b03-2876938fc726 in Status: IN_PROGRESS for 2s [ 844.304454] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bbd48a8-069c-43ef-b15c-47d19b8c7798 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.304944] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.305162] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4bbd48a8-069c-43ef-b15c-47d19b8c7798',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.306099] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 108a6b61-947f-4dab-8fe2-39fd27ee36db with status ACTIVE [ 844.306262] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.306409] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.306472] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.306727] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.306822] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.306956] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.307071] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.307125] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.307288] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.307381] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.307643] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.307752] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.307840] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.307949] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.309181] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.309323] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 108a6b61-947f-4dab-8fe2-39fd27ee36db is going to be updated. [ 844.329552] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.329775] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.329775] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.329967] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.330188] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.330337] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-108a6b61-947f-4dab-8fe2-39fd27ee36db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.371749] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d160efa7-0312-433f-b94f-cf7e99e24473',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.693833] env[68328]: INFO networking_nsxv3.common.synchronization [req-a37fd7ef-4d7f-4bc9-9c9b-f503de0180fa req-0c94f179-5345-4dd9-98c2-74405223cd41 tempest-ListServersNegativeTestJSON-482599207 tempest-ListServersNegativeTestJSON-482599207-project-member] Enqueued Resource ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 with Priority: HIGHEST for action security_group_members [ 844.694022] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 with Priority: HIGHEST for action security_group_members [ 844.694065] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 with Priority: HIGH for action security_group_rules [ 844.694171] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 with Priority: HIGH for action security_group_rules [ 844.696951] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14cff10c-171f-4bbf-8531-6de5c6c7cc48 with Priority: HIGH for action security_group_rules [ 844.698595] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d160efa7-0312-433f-b94f-cf7e99e24473 with Priority: HIGH for action security_group_rules [ 844.698595] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8026099-4b7a-433d-98f2-b33d3f0a6907 with Priority: HIGH for action security_group_rules [ 844.698595] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24a59c7c-3185-4ae4-af15-7deeba4a037c with Priority: HIGH for action security_group_rules [ 844.698595] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f302de28-ce4b-4460-9ba9-d832cf4c957e with Priority: HIGH for action security_group_rules [ 844.698595] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc with Priority: HIGH for action security_group_rules [ 844.698595] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b95bc2dc-a214-45b1-8103-2bccad318c7b with Priority: HIGH for action security_group_rules [ 844.698595] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed with Priority: HIGH for action security_group_rules [ 844.698595] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02ce0770-2d9f-451b-8bc9-6982e5dbf513 with Priority: HIGH for action security_group_rules [ 844.698595] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 with Priority: HIGH for action security_group_rules [ 844.698595] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61fb3384-8e34-4731-a436-48440a87fd65 with Priority: HIGH for action security_group_rules [ 844.698595] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76f74d16-9031-4472-a81b-f9ada0520a34 with Priority: HIGH for action security_group_rules [ 844.698980] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6de510a-9045-41b5-b9c0-0c2740830426 with Priority: HIGH for action security_group_rules [ 844.698980] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f95f28e-3c21-415e-9067-7aef8eff10d3 with Priority: HIGH for action security_group_rules [ 844.698980] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e399462-679e-43d6-8b03-2876938fc726 with Priority: HIGH for action security_group_rules [ 844.698980] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96047272-421b-4187-99a6-e18e4a01bfc9 with Priority: HIGH for action security_group_rules [ 844.698980] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 with Priority: HIGH for action security_group_rules [ 844.699139] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 with Priority: HIGH for action security_group_rules [ 844.699459] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bbd48a8-069c-43ef-b15c-47d19b8c7798 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.699615] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.701120] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.701120] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.701120] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.701120] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.701120] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ccbebeb4-60d7-4344-b96e-b9dfdeae14b1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.702450] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-870ec36b-ba1d-4422-a26d-1328f51f79e4 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.702573] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.702628] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.702817] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.702897] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.704158] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14cff10c-171f-4bbf-8531-6de5c6c7cc48 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.704274] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14cff10c-171f-4bbf-8531-6de5c6c7cc48" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.704331] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14cff10c-171f-4bbf-8531-6de5c6c7cc48" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.704548] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14cff10c-171f-4bbf-8531-6de5c6c7cc48" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.704621] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14cff10c-171f-4bbf-8531-6de5c6c7cc48',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.705338] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d160efa7-0312-433f-b94f-cf7e99e24473 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.705448] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.705513] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.705663] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.705736] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d160efa7-0312-433f-b94f-cf7e99e24473',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.706433] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c8026099-4b7a-433d-98f2-b33d3f0a6907 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.706537] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c8026099-4b7a-433d-98f2-b33d3f0a6907" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.706594] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c8026099-4b7a-433d-98f2-b33d3f0a6907" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.706892] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c8026099-4b7a-433d-98f2-b33d3f0a6907" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.706892] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c8026099-4b7a-433d-98f2-b33d3f0a6907',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.707550] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24a59c7c-3185-4ae4-af15-7deeba4a037c taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.707596] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24a59c7c-3185-4ae4-af15-7deeba4a037c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.707651] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24a59c7c-3185-4ae4-af15-7deeba4a037c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.707798] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24a59c7c-3185-4ae4-af15-7deeba4a037c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.707869] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24a59c7c-3185-4ae4-af15-7deeba4a037c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.709204] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f302de28-ce4b-4460-9ba9-d832cf4c957e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.709459] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.709459] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.709723] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.709723] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f302de28-ce4b-4460-9ba9-d832cf4c957e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.710581] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.710685] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.710737] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.710885] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.710956] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba6f8661-b38c-4d97-a1c5-4a0e33e341bc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.711996] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b95bc2dc-a214-45b1-8103-2bccad318c7b taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.712120] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b95bc2dc-a214-45b1-8103-2bccad318c7b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.712203] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b95bc2dc-a214-45b1-8103-2bccad318c7b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.712369] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b95bc2dc-a214-45b1-8103-2bccad318c7b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.712503] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b95bc2dc-a214-45b1-8103-2bccad318c7b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.712783] env[68328]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 844.713565] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.713673] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.713738] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.713935] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.713986] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.714767] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-02ce0770-2d9f-451b-8bc9-6982e5dbf513 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.714872] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-02ce0770-2d9f-451b-8bc9-6982e5dbf513" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.714931] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-02ce0770-2d9f-451b-8bc9-6982e5dbf513" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.715260] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-02ce0770-2d9f-451b-8bc9-6982e5dbf513" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.715260] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('02ce0770-2d9f-451b-8bc9-6982e5dbf513',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.717147] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.717316] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.717316] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.718695] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.718695] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('398e93bc-b7ea-4684-aa02-2e6ab22c1fe5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.718695] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-61fb3384-8e34-4731-a436-48440a87fd65 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.718695] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-61fb3384-8e34-4731-a436-48440a87fd65" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.718695] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-61fb3384-8e34-4731-a436-48440a87fd65" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.718984] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-61fb3384-8e34-4731-a436-48440a87fd65" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.718984] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('61fb3384-8e34-4731-a436-48440a87fd65',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.719782] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76f74d16-9031-4472-a81b-f9ada0520a34 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.720781] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76f74d16-9031-4472-a81b-f9ada0520a34" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.720781] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76f74d16-9031-4472-a81b-f9ada0520a34" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.720781] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76f74d16-9031-4472-a81b-f9ada0520a34" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.720781] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76f74d16-9031-4472-a81b-f9ada0520a34',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.721460] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6de510a-9045-41b5-b9c0-0c2740830426 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.721599] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6de510a-9045-41b5-b9c0-0c2740830426" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.721641] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6de510a-9045-41b5-b9c0-0c2740830426" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.725017] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6de510a-9045-41b5-b9c0-0c2740830426" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.725017] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6de510a-9045-41b5-b9c0-0c2740830426',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.725017] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f95f28e-3c21-415e-9067-7aef8eff10d3 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.725017] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f95f28e-3c21-415e-9067-7aef8eff10d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.725017] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f95f28e-3c21-415e-9067-7aef8eff10d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.725017] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f95f28e-3c21-415e-9067-7aef8eff10d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.725017] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f95f28e-3c21-415e-9067-7aef8eff10d3',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.725017] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e399462-679e-43d6-8b03-2876938fc726 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.725017] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.725017] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-96047272-421b-4187-99a6-e18e4a01bfc9 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.725017] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.725017] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.725017] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.725017] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('96047272-421b-4187-99a6-e18e4a01bfc9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.725587] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55f209f1-d8fe-4d5e-a886-797753b1b3c1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.725587] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.725587] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.725696] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.725696] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55f209f1-d8fe-4d5e-a886-797753b1b3c1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.726597] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-249b36cf-74ee-44d9-b2c9-d728a30d9a09 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.726807] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.726878] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.727100] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.727172] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('249b36cf-74ee-44d9-b2c9-d728a30d9a09',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.727436] env[68328]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 844.811734] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4bbd48a8-069c-43ef-b15c-47d19b8c7798',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.874164] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d160efa7-0312-433f-b94f-cf7e99e24473',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.129046] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-424 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.129046] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-424" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.129563] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-424" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.129563] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-424" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.129815] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.129815] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.129990] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.132275] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.132439] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.132659] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 845.132775] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 845.132883] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 845.132990] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 845.134030] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 845.134030] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 845.134030] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 845.152020] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 845.152180] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 845.152317] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 845.152490] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-424" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.153096] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-aa933556-42d4-4172-82bd-3dd937173256 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.153096] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-aa933556-42d4-4172-82bd-3dd937173256" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.153096] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-aa933556-42d4-4172-82bd-3dd937173256" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.153875] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-aa933556-42d4-4172-82bd-3dd937173256" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.153875] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa933556-42d4-4172-82bd-3dd937173256',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.202922] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.203081] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.203202] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.203931] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.203931] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.203931] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.203931] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.203931] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.203931] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.204242] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.204242] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ccbebeb4-60d7-4344-b96e-b9dfdeae14b1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.231321] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-d160efa7-0312-433f-b94f-cf7e99e24473 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.231490] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.231696] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-14cff10c-171f-4bbf-8531-6de5c6c7cc48 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.231800] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14cff10c-171f-4bbf-8531-6de5c6c7cc48" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.231873] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14cff10c-171f-4bbf-8531-6de5c6c7cc48" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.232082] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14cff10c-171f-4bbf-8531-6de5c6c7cc48" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.232240] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.232333] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.232396] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.232577] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.232662] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.232748] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14cff10c-171f-4bbf-8531-6de5c6c7cc48" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.232833] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('14cff10c-171f-4bbf-8531-6de5c6c7cc48',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.233728] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-870ec36b-ba1d-4422-a26d-1328f51f79e4 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.233835] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.233900] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.234175] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.234335] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.234431] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.234493] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.234635] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.234711] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.234790] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.234871] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.245380] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.245505] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.245573] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.245748] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.253538] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f95f28e-3c21-415e-9067-7aef8eff10d3 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.253662] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f95f28e-3c21-415e-9067-7aef8eff10d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.253732] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f95f28e-3c21-415e-9067-7aef8eff10d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.253919] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f95f28e-3c21-415e-9067-7aef8eff10d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.254137] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.254208] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.254274] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.254427] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.254512] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.254628] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f95f28e-3c21-415e-9067-7aef8eff10d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.254718] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8f95f28e-3c21-415e-9067-7aef8eff10d3',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.257377] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6de510a-9045-41b5-b9c0-0c2740830426 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.257451] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6de510a-9045-41b5-b9c0-0c2740830426" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.257548] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6de510a-9045-41b5-b9c0-0c2740830426" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.257668] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6de510a-9045-41b5-b9c0-0c2740830426" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.257813] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.257907] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.257967] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.258125] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.258201] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.258397] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6de510a-9045-41b5-b9c0-0c2740830426" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.258397] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e6de510a-9045-41b5-b9c0-0c2740830426',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.263708] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.263832] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.263929] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.264113] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.264291] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.264390] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.264452] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.264598] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.264678] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.264761] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.264843] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('398e93bc-b7ea-4684-aa02-2e6ab22c1fe5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.267425] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-76f74d16-9031-4472-a81b-f9ada0520a34 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.267538] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76f74d16-9031-4472-a81b-f9ada0520a34" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.267604] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76f74d16-9031-4472-a81b-f9ada0520a34" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.268039] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76f74d16-9031-4472-a81b-f9ada0520a34" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.268039] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.268338] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.268405] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.272025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.272025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.272025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76f74d16-9031-4472-a81b-f9ada0520a34" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.272025] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('76f74d16-9031-4472-a81b-f9ada0520a34',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.273597] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.273715] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.273765] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.273929] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.274128] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.274283] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.274331] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.274441] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.274520] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.274604] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.274683] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.275942] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-249b36cf-74ee-44d9-b2c9-d728a30d9a09 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.275942] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.275942] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.276140] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.276480] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.276480] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.276480] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.276645] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.276679] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.277461] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.277461] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('249b36cf-74ee-44d9-b2c9-d728a30d9a09',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.289339] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.289339] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.289339] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.289339] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.289339] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.289339] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.289339] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.289339] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.289339] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.289339] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.289339] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.289339] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.289339] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.289339] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.289339] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.289339] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.289913] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.289913] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.289913] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.289913] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.289913] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('398e93bc-b7ea-4684-aa02-2e6ab22c1fe5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.289913] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.289913] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c8026099-4b7a-433d-98f2-b33d3f0a6907 is going to be deleted. [ 845.309199] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.309379] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.309426] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.309620] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.311251] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.311368] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.312803] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.312803] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.313167] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.313262] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.313894] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.314152] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.314680] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.314792] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.315358] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.315467] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.315533] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.315715] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.315867] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.315906] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 is going to be created. [ 845.317708] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.317978] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.321216] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.321309] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.327315] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.327429] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b95bc2dc-a214-45b1-8103-2bccad318c7b is going to be deleted. [ 845.328258] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.328517] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.337734] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.337881] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.337923] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.338153] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.338279] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.345585] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.345630] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 96047272-421b-4187-99a6-e18e4a01bfc9 is going to be deleted. [ 845.346463] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.346662] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.347989] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 in Status: UNINITIALIZED for 2s [ 845.349824] env[68328]: INFO networking_nsxv3.common.synchronization [None req-ed8d49c9-52e9-4c20-97f9-4402648fe99e None None] Enqueued Resource ID: f3c07271-ad70-43d0-a4c9-546b46648e6e with Priority: HIGHEST for action port [ 845.350892] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3c07271-ad70-43d0-a4c9-546b46648e6e with Priority: HIGHEST for action port [ 845.350892] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3c07271-ad70-43d0-a4c9-546b46648e6e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.351017] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3c07271-ad70-43d0-a4c9-546b46648e6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.351017] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3c07271-ad70-43d0-a4c9-546b46648e6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.351827] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3c07271-ad70-43d0-a4c9-546b46648e6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.351827] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3c07271-ad70-43d0-a4c9-546b46648e6e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.361933] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.362078] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.365812] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.365812] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba6f8661-b38c-4d97-a1c5-4a0e33e341bc is going to be deleted. [ 845.367767] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.367767] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.376640] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.376760] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.376827] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.377028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.377114] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.377207] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d160efa7-0312-433f-b94f-cf7e99e24473 is going to be updated. [ 845.384856] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.385453] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 02ce0770-2d9f-451b-8bc9-6982e5dbf513 is going to be deleted. [ 845.385807] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.386010] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.407063] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.407207] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f302de28-ce4b-4460-9ba9-d832cf4c957e is going to be deleted. [ 845.408066] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.408274] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.409652] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.409757] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.410575] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.410730] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.422566] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.422711] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.428216] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.428340] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.428461] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.428683] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.428731] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.430714] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.430827] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24a59c7c-3185-4ae4-af15-7deeba4a037c is going to be deleted. [ 845.432157] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.432157] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.445710] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d160efa7-0312-433f-b94f-cf7e99e24473 in Status: IN_PROGRESS for 2s [ 845.456019] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.456019] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 61fb3384-8e34-4731-a436-48440a87fd65 is going to be deleted. [ 845.456019] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.456019] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.524100] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.524258] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.525023] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.525116] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.529044] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.529167] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 is going to be deleted. [ 845.530047] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.530332] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.530424] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.530542] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c8026099-4b7a-433d-98f2-b33d3f0a6907" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.530713] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.530877] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.530959] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.531083] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-96047272-421b-4187-99a6-e18e4a01bfc9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.531597] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.531793] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.531885] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.532054] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b95bc2dc-a214-45b1-8103-2bccad318c7b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.532216] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.532366] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.532542] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.532645] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba6f8661-b38c-4d97-a1c5-4a0e33e341bc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.532743] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.532883] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.532955] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.533074] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f302de28-ce4b-4460-9ba9-d832cf4c957e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.533198] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.533338] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.533401] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.533508] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-02ce0770-2d9f-451b-8bc9-6982e5dbf513" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.604526] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.604702] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.604780] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.604949] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.605135] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.605198] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24a59c7c-3185-4ae4-af15-7deeba4a037c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.605945] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.606075] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.606189] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.606347] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.606440] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.606546] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-61fb3384-8e34-4731-a436-48440a87fd65" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.655927] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.656185] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.656315] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.657127] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.657127] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.657127] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port aa933556-42d4-4172-82bd-3dd937173256 not found, creating... [ 845.657300] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.657366] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.657519] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.657707] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.657846] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.658163] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.658325] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.658452] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.658624] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.658757] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.658897] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: aa933556-42d4-4172-82bd-3dd937173256 is going to be created. [ 845.676207] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.677009] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.677009] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.677009] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.677009] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.677009] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.706006] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.706184] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.706260] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.706482] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.706916] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.706916] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.707054] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.707175] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.707268] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.707391] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.707553] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.707667] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.707705] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.707844] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.707976] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.708094] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.708163] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.708366] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.708366] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.708479] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.708554] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ccbebeb4-60d7-4344-b96e-b9dfdeae14b1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.732103] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.732442] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.732613] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.733063] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.736355] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.736698] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-aa933556-42d4-4172-82bd-3dd937173256" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.737705] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('14cff10c-171f-4bbf-8531-6de5c6c7cc48',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.738778] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-870ec36b-ba1d-4422-a26d-1328f51f79e4 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.739107] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.739107] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.739250] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.739326] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.739423] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.739490] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.739642] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.739730] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.739809] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.739949] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-870ec36b-ba1d-4422-a26d-1328f51f79e4 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.740050] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.740110] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.740306] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.740545] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.740545] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.740708] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.740708] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.740804] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.740860] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.740908] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.757845] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8f95f28e-3c21-415e-9067-7aef8eff10d3',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.779484] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e6de510a-9045-41b5-b9c0-0c2740830426',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.783908] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.783908] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.783908] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.784253] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.784310] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.784393] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.784457] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.784607] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.784710] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.784839] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.784988] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.785124] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.785124] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.785261] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.785785] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.785785] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.785785] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.785785] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.785785] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.785785] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.786470] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.786748] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-249b36cf-74ee-44d9-b2c9-d728a30d9a09 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.786912] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.786963] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.787132] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.787273] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.787374] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.787432] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.787541] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.787616] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.787694] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.787827] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-249b36cf-74ee-44d9-b2c9-d728a30d9a09 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.787924] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.788044] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.788250] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.788320] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.788415] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.788782] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.788782] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.788782] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.788782] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.788782] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('249b36cf-74ee-44d9-b2c9-d728a30d9a09',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.790773] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('76f74d16-9031-4472-a81b-f9ada0520a34',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.792942] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5: rpc.has_security_group_logging(os_id): False [ 845.815723] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.815723] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.816291] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.816291] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.852826] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.852826] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.852998] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.852998] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.853236] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.853324] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.853523] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.853615] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.853664] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.853811] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.853881] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.854090] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.854230] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.854311] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.855438] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.855438] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.855931] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 is going to be updated. [ 845.858026] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f3c07271-ad70-43d0-a4c9-546b46648e6e [ 845.858200] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.858334] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.858416] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.858561] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.858619] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.858674] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f3c07271-ad70-43d0-a4c9-546b46648e6e already deleted. [ 845.858755] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3c07271-ad70-43d0-a4c9-546b46648e6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.954640] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.954799] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.954871] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.955162] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.955228] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.964217] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e399462-679e-43d6-8b03-2876938fc726 in Status: SUCCESS [ 845.964446] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.965870] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 in Status: IN_PROGRESS for 2s [ 845.966043] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.966276] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.966621] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e399462-679e-43d6-8b03-2876938fc726',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.210516] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ccbebeb4-60d7-4344-b96e-b9dfdeae14b1: rpc.has_security_group_logging(os_id): False [ 846.229723] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.229894] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.229955] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.230195] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.247477] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 14cff10c-171f-4bbf-8531-6de5c6c7cc48: rpc.has_security_group_logging(os_id): False [ 846.251027] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 870ec36b-ba1d-4422-a26d-1328f51f79e4: rpc.has_security_group_logging(os_id): False [ 846.256808] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.256808] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.256808] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.256808] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.256808] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.256808] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.256808] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.256808] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.256808] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.256808] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.257921] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.257921] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.257921] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.257921] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.257921] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.257921] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.257921] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 is going to be updated. [ 846.261316] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8f95f28e-3c21-415e-9067-7aef8eff10d3: rpc.has_security_group_logging(os_id): False [ 846.268365] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.268365] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.268365] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.268365] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.268365] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.268365] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.286229] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.287824] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.287824] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e6de510a-9045-41b5-b9c0-0c2740830426: rpc.has_security_group_logging(os_id): False [ 846.288988] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.288988] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.289228] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.289335] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.289589] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.289723] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.290029] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.290437] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.290437] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.291251] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.291389] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.291613] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.291703] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.291768] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.291938] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.292078] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.292211] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 is going to be updated. [ 846.293414] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.293610] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.296067] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed: rpc.has_security_group_logging(os_id): False [ 846.297184] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 249b36cf-74ee-44d9-b2c9-d728a30d9a09: rpc.has_security_group_logging(os_id): False [ 846.297825] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 76f74d16-9031-4472-a81b-f9ada0520a34: rpc.has_security_group_logging(os_id): False [ 846.315680] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.315888] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.316796] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.316888] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.319853] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.319853] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.319853] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.319853] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.320062] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.320240] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.320298] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14cff10c-171f-4bbf-8531-6de5c6c7cc48 is going to be updated. [ 846.321417] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.321531] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.325426] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.325574] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.328014] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.328296] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.330184] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.330184] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.345717] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.345717] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.345717] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.345717] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.345717] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.345717] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.345717] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f95f28e-3c21-415e-9067-7aef8eff10d3 is going to be updated. [ 846.346196] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.346408] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.365244] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.365580] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.365771] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.365891] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.366164] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.366237] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.366315] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76f74d16-9031-4472-a81b-f9ada0520a34 is going to be updated. [ 846.367445] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.367581] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.369852] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.369955] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.387509] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.387781] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.387903] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.387971] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.388200] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.388282] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.388554] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.388642] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.388642] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.388795] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.388868] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.389067] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.389149] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.389211] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.389350] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.389424] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.389516] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 is going to be updated. [ 846.390683] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.390885] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.391061] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.392330] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.392599] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.397042] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.397229] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.400720] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.400843] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.432696] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.432977] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.433146] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.433236] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.433486] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.433599] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.433830] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.433951] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.434054] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.434263] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.434433] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.434667] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.434732] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.434819] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.434939] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.435126] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.435261] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed is going to be updated. [ 846.436611] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.437177] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.437177] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.438094] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.438320] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.444459] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 in Status: IN_PROGRESS for 2s [ 846.466215] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 in Status: IN_PROGRESS for 2s [ 846.474175] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.474175] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.474175] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.474175] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.474175] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.474175] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.474175] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6de510a-9045-41b5-b9c0-0c2740830426 is going to be updated. [ 846.474175] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e399462-679e-43d6-8b03-2876938fc726 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.474544] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.474544] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.474544] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.474688] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.474688] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.474776] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.474901] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.474998] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.475070] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.475153] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3e399462-679e-43d6-8b03-2876938fc726',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.475972] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.476100] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.476242] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.478383] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.478383] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.478383] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.483450] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.483649] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.483734] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.483960] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.484142] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.527112] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.527614] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.527801] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.528331] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.530158] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.532212] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f95f28e-3c21-415e-9067-7aef8eff10d3 in Status: IN_PROGRESS for 2s [ 846.533053] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14cff10c-171f-4bbf-8531-6de5c6c7cc48 in Status: IN_PROGRESS for 2s [ 846.535435] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76f74d16-9031-4472-a81b-f9ada0520a34 in Status: IN_PROGRESS for 2s [ 846.567617] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.567617] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.567617] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.567617] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.567617] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.613279] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed in Status: IN_PROGRESS for 2s [ 846.613279] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 in Status: IN_PROGRESS for 2s [ 846.632418] env[68328]: INFO networking_nsxv3.common.synchronization [req-a37fd7ef-4d7f-4bc9-9c9b-f503de0180fa req-54c65091-3248-458b-bb96-dc3a8d226582 service nova] Enqueued Resource ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 with Priority: HIGHEST for action security_group_rules [ 846.633460] env[68328]: INFO networking_nsxv3.common.synchronization [req-a37fd7ef-4d7f-4bc9-9c9b-f503de0180fa req-54c65091-3248-458b-bb96-dc3a8d226582 service nova] Enqueued Resource ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 with Priority: HIGHEST for action security_group_members [ 846.633460] env[68328]: INFO networking_nsxv3.common.synchronization [req-a37fd7ef-4d7f-4bc9-9c9b-f503de0180fa req-54c65091-3248-458b-bb96-dc3a8d226582 service nova] Enqueued Resource ID: aa933556-42d4-4172-82bd-3dd937173256 with Priority: HIGHEST for action port [ 846.634139] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 with Priority: HIGHEST for action security_group_rules [ 846.637838] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 with Priority: HIGHEST for action security_group_members [ 846.637838] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa933556-42d4-4172-82bd-3dd937173256 with Priority: HIGHEST for action port [ 846.637838] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4bbd48a8-069c-43ef-b15c-47d19b8c7798 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.637838] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.637838] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bbd48a8-069c-43ef-b15c-47d19b8c7798 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.637838] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.637838] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa933556-42d4-4172-82bd-3dd937173256 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.637838] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa933556-42d4-4172-82bd-3dd937173256" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.637838] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa933556-42d4-4172-82bd-3dd937173256" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.637838] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa933556-42d4-4172-82bd-3dd937173256" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.637838] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa933556-42d4-4172-82bd-3dd937173256',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.658332] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.658332] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.658332] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.658699] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.658978] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.696560] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6de510a-9045-41b5-b9c0-0c2740830426 in Status: IN_PROGRESS for 2s [ 846.761719] env[68328]: INFO networking_nsxv3.common.synchronization [None req-27424681-5323-4638-be74-7c82739dfcb4 tempest-ServerActionsTestOtherB-24837534 tempest-ServerActionsTestOtherB-24837534-project-member] Enqueued Resource ID: 54390b69-5280-4540-a63f-fa4daae4a11f with Priority: HIGHEST for action security_group_rules [ 846.763207] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54390b69-5280-4540-a63f-fa4daae4a11f with Priority: HIGHEST for action security_group_rules [ 846.763207] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54390b69-5280-4540-a63f-fa4daae4a11f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.763207] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.765085] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.765085] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.765085] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54390b69-5280-4540-a63f-fa4daae4a11f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.856343] env[68328]: INFO networking_nsxv3.common.synchronization [None req-f5d9e4df-b21a-4ffe-8adf-fa04c7baae37 tempest-ServerActionsTestOtherB-24837534 tempest-ServerActionsTestOtherB-24837534-project-member] Enqueued Resource ID: 54390b69-5280-4540-a63f-fa4daae4a11f with Priority: HIGHEST for action security_group_rules [ 846.856622] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54390b69-5280-4540-a63f-fa4daae4a11f with Priority: HIGHEST for action security_group_rules [ 846.856868] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54390b69-5280-4540-a63f-fa4daae4a11f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.856868] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.980693] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3e399462-679e-43d6-8b03-2876938fc726',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.066477] env[68328]: INFO networking_nsxv3.common.synchronization [req-a37fd7ef-4d7f-4bc9-9c9b-f503de0180fa req-b64c3d93-d7b7-499a-8313-3898570baa60 tempest-ListServersNegativeTestJSON-482599207 tempest-ListServersNegativeTestJSON-482599207-project-member] Enqueued Resource ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 with Priority: HIGHEST for action security_group_members [ 847.068173] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 with Priority: HIGHEST for action security_group_members [ 847.068478] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bbd48a8-069c-43ef-b15c-47d19b8c7798 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.068594] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.141867] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aa933556-42d4-4172-82bd-3dd937173256 with status ACTIVE [ 847.141867] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.141867] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.141867] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.141867] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.141867] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.141867] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.141867] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.141867] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.142249] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.142249] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.142318] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.142368] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.142403] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.142588] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.142588] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.142699] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aa933556-42d4-4172-82bd-3dd937173256 is going to be updated. [ 847.161517] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.161517] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.161517] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.161762] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.161762] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.162037] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa933556-42d4-4172-82bd-3dd937173256" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.412965] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-424 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.413176] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-424" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.413298] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-424" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.413559] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-424" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.413819] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.413971] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.414094] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.415539] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.415539] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.415539] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 847.415539] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 847.415539] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 847.415539] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 847.415539] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 847.415539] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 847.415539] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 847.416770] env[68328]: INFO networking_nsxv3.common.synchronization [None req-2c243b2b-5442-4684-8f95-a636b8124e03 None None] Enqueued Resource ID: 22da623c-1bc9-4096-9c57-09097100927d with Priority: HIGHEST for action port [ 847.417446] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22da623c-1bc9-4096-9c57-09097100927d with Priority: HIGHEST for action port [ 847.418490] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-22da623c-1bc9-4096-9c57-09097100927d taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.418587] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-22da623c-1bc9-4096-9c57-09097100927d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.418658] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-22da623c-1bc9-4096-9c57-09097100927d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.418865] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-22da623c-1bc9-4096-9c57-09097100927d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.418946] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22da623c-1bc9-4096-9c57-09097100927d',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.430484] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 in Status: SUCCESS [ 847.430677] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.430827] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.431139] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.431229] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.431376] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.431415] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.431538] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.431616] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.431744] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.431790] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4bbd48a8-069c-43ef-b15c-47d19b8c7798',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.433165] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.433265] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.433331] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.433478] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.433553] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.433639] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54390b69-5280-4540-a63f-fa4daae4a11f already deleted. [ 847.433718] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.434318] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.434485] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.434624] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.434759] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.434801] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.434904] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.434978] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.435077] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4bbd48a8-069c-43ef-b15c-47d19b8c7798',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.436097] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.436261] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.436341] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54390b69-5280-4540-a63f-fa4daae4a11f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.448295] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 847.448463] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 847.448602] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 847.448767] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-424" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.449066] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-65f2c7c1-a81f-4b07-aea3-5d9a489def28 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.449230] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-65f2c7c1-a81f-4b07-aea3-5d9a489def28" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.449352] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-65f2c7c1-a81f-4b07-aea3-5d9a489def28" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.449639] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-65f2c7c1-a81f-4b07-aea3-5d9a489def28" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.449772] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65f2c7c1-a81f-4b07-aea3-5d9a489def28',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.454330] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d160efa7-0312-433f-b94f-cf7e99e24473 in Status: SUCCESS [ 847.454519] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.454665] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.454840] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.455427] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.455427] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.455427] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.455427] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.455427] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.455682] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.455682] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d160efa7-0312-433f-b94f-cf7e99e24473',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.483203] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3e399462-679e-43d6-8b03-2876938fc726: rpc.has_security_group_logging(os_id): False [ 847.497922] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.498166] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.498244] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.498463] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.498552] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.498807] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.498907] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.498983] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.499132] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.499209] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.499296] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e399462-679e-43d6-8b03-2876938fc726 is going to be updated. [ 847.551768] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.551923] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.551990] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.552308] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.552378] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.566991] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e399462-679e-43d6-8b03-2876938fc726 in Status: IN_PROGRESS for 2s [ 847.921311] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 22da623c-1bc9-4096-9c57-09097100927d [ 847.921610] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.921963] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.922075] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.922298] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.922392] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.922490] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:22da623c-1bc9-4096-9c57-09097100927d already deleted. [ 847.922645] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-22da623c-1bc9-4096-9c57-09097100927d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.942023] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4bbd48a8-069c-43ef-b15c-47d19b8c7798',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.942023] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bbd48a8-069c-43ef-b15c-47d19b8c7798 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.942023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.952713] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.952939] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.954484] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.954484] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.954484] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.954484] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 65f2c7c1-a81f-4b07-aea3-5d9a489def28 not found, creating... [ 847.954484] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.954484] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.954484] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.954484] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.955182] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.955182] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.955182] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.955298] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.955430] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.955559] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.955762] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 65f2c7c1-a81f-4b07-aea3-5d9a489def28 is going to be created. [ 847.958704] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.958845] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.958906] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.959058] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.959142] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.959229] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54390b69-5280-4540-a63f-fa4daae4a11f already deleted. [ 847.959308] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.959632] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-d160efa7-0312-433f-b94f-cf7e99e24473 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.959753] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.959812] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.959963] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.960118] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.960250] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.960343] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.960486] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.960562] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.960643] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.960787] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-d160efa7-0312-433f-b94f-cf7e99e24473 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.960877] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.960936] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.961079] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.961253] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.961354] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.961429] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.961599] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.961644] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.965103] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.965258] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d160efa7-0312-433f-b94f-cf7e99e24473',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.980496] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 in Status: SUCCESS [ 847.980729] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.985089] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.985230] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.985358] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.985626] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.985850] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.986290] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-65f2c7c1-a81f-4b07-aea3-5d9a489def28" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.441977] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4bbd48a8-069c-43ef-b15c-47d19b8c7798',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.469842] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 in Status: SUCCESS [ 848.469842] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.469842] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d160efa7-0312-433f-b94f-cf7e99e24473: rpc.has_security_group_logging(os_id): False [ 848.489027] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.489221] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.489265] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.489486] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.491778] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 in Status: SUCCESS [ 848.491995] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.509772] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.510044] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.510279] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.510369] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.510982] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.510982] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.512251] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.512251] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.512251] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.512251] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.512251] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.512251] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.512251] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.512251] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.512251] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.512709] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.512709] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d160efa7-0312-433f-b94f-cf7e99e24473 is going to be updated. [ 848.545852] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76f74d16-9031-4472-a81b-f9ada0520a34 in Status: SUCCESS [ 848.545852] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76f74d16-9031-4472-a81b-f9ada0520a34" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.546629] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14cff10c-171f-4bbf-8531-6de5c6c7cc48 in Status: SUCCESS [ 848.546773] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14cff10c-171f-4bbf-8531-6de5c6c7cc48" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.547694] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f95f28e-3c21-415e-9067-7aef8eff10d3 in Status: SUCCESS [ 848.547694] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f95f28e-3c21-415e-9067-7aef8eff10d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.586379] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.586379] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.586379] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.586379] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.586379] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.607932] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d160efa7-0312-433f-b94f-cf7e99e24473 in Status: IN_PROGRESS for 2s [ 848.624787] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed in Status: SUCCESS [ 848.624787] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.625734] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 in Status: SUCCESS [ 848.625974] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.714068] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6de510a-9045-41b5-b9c0-0c2740830426 in Status: SUCCESS [ 848.714311] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6de510a-9045-41b5-b9c0-0c2740830426" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.922418] env[68328]: INFO networking_nsxv3.common.synchronization [req-a37fd7ef-4d7f-4bc9-9c9b-f503de0180fa req-29556d12-f110-494b-a746-ac8507d9418a service nova] Enqueued Resource ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 with Priority: HIGHEST for action security_group_rules [ 848.924434] env[68328]: INFO networking_nsxv3.common.synchronization [req-a37fd7ef-4d7f-4bc9-9c9b-f503de0180fa req-29556d12-f110-494b-a746-ac8507d9418a service nova] Enqueued Resource ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 with Priority: HIGHEST for action security_group_members [ 848.925921] env[68328]: INFO networking_nsxv3.common.synchronization [req-a37fd7ef-4d7f-4bc9-9c9b-f503de0180fa req-29556d12-f110-494b-a746-ac8507d9418a service nova] Enqueued Resource ID: 65f2c7c1-a81f-4b07-aea3-5d9a489def28 with Priority: HIGHEST for action port [ 848.925921] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 with Priority: HIGHEST for action security_group_rules [ 848.925921] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 with Priority: HIGHEST for action security_group_members [ 848.925921] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65f2c7c1-a81f-4b07-aea3-5d9a489def28 with Priority: HIGHEST for action port [ 848.926623] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4bbd48a8-069c-43ef-b15c-47d19b8c7798 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.926863] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.927198] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bbd48a8-069c-43ef-b15c-47d19b8c7798 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.927506] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.927784] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-65f2c7c1-a81f-4b07-aea3-5d9a489def28 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.928035] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-65f2c7c1-a81f-4b07-aea3-5d9a489def28" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.928216] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-65f2c7c1-a81f-4b07-aea3-5d9a489def28" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.928534] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-65f2c7c1-a81f-4b07-aea3-5d9a489def28" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.928713] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65f2c7c1-a81f-4b07-aea3-5d9a489def28',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.949453] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.951825] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.951825] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.951825] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.951825] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.951825] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 is going to be updated. [ 848.978261] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.978261] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.978261] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.978261] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.978261] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.986510] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 in Status: IN_PROGRESS for 2s [ 849.133316] env[68328]: INFO networking_nsxv3.common.synchronization [req-4b499668-bd33-45b9-a687-b20722d3845e req-0d95a29e-052e-41a9-89d8-3ac0e27fc754 tempest-AttachInterfacesTestJSON-966841523 tempest-AttachInterfacesTestJSON-966841523-project-member] Enqueued Resource ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 with Priority: HIGHEST for action security_group_members [ 849.133316] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 with Priority: HIGHEST for action security_group_members [ 849.134378] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.134378] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.134378] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.134722] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.134818] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.134937] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.135110] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.135199] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.135314] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.135425] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('398e93bc-b7ea-4684-aa02-2e6ab22c1fe5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.432491] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 65f2c7c1-a81f-4b07-aea3-5d9a489def28 with status ACTIVE [ 849.432731] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.432866] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.432949] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.433182] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.433591] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.433591] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.433734] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.433734] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.433878] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.433968] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.434183] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.434286] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.434353] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.434465] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.434534] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.434615] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 65f2c7c1-a81f-4b07-aea3-5d9a489def28 is going to be updated. [ 849.453780] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.454688] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.454688] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.454688] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.454688] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.454688] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-65f2c7c1-a81f-4b07-aea3-5d9a489def28" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.579121] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e399462-679e-43d6-8b03-2876938fc726 in Status: SUCCESS [ 849.579358] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.640725] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.640725] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.640725] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.640725] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.640725] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.640725] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.640725] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.640725] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.640725] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.640725] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.640725] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 is going to be updated. [ 849.667697] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.668072] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.668072] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.668191] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.668323] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.681205] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 in Status: IN_PROGRESS for 2s [ 850.620355] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d160efa7-0312-433f-b94f-cf7e99e24473 in Status: SUCCESS [ 850.620672] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.999533] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 in Status: SUCCESS [ 851.000026] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.000358] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.000901] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.001258] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.001637] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.001825] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.002126] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.002793] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.002793] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4bbd48a8-069c-43ef-b15c-47d19b8c7798',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.505378] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4bbd48a8-069c-43ef-b15c-47d19b8c7798',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.692262] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 in Status: SUCCESS [ 851.692655] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 deletion is rescheduled due to dependency. [ 851.692655] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.007677] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4bbd48a8-069c-43ef-b15c-47d19b8c7798',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.510727] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.510885] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.510960] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.511235] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.511492] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.511687] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 is going to be updated. [ 852.537907] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.538120] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.538120] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.538367] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.538514] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.546507] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 in Status: IN_PROGRESS for 2s [ 852.677671] env[68328]: INFO networking_nsxv3.common.synchronization [req-e9d2f0cd-b912-4fd9-aaa0-cf2fafcd6636 req-4a18e1e5-fe30-4249-9af7-d07958835106 tempest-ServersV294TestFqdnHostnames-1189707928 tempest-ServersV294TestFqdnHostnames-1189707928-project-member] Enqueued Resource ID: 14cff10c-171f-4bbf-8531-6de5c6c7cc48 with Priority: HIGHEST for action security_group_members [ 852.678570] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14cff10c-171f-4bbf-8531-6de5c6c7cc48 with Priority: HIGHEST for action security_group_members [ 852.678880] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-14cff10c-171f-4bbf-8531-6de5c6c7cc48 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.679010] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14cff10c-171f-4bbf-8531-6de5c6c7cc48" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.679080] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14cff10c-171f-4bbf-8531-6de5c6c7cc48" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.679284] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14cff10c-171f-4bbf-8531-6de5c6c7cc48" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.679430] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.679522] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.679579] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.679720] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.680495] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.680495] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14cff10c-171f-4bbf-8531-6de5c6c7cc48',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.182436] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.182755] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.182755] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.182890] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.183015] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.183217] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.183315] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.183411] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.183625] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.183742] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.184058] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14cff10c-171f-4bbf-8531-6de5c6c7cc48 is going to be updated. [ 853.207269] env[68328]: INFO networking_nsxv3.common.synchronization [req-f19de3c3-1bc2-4ef3-8ff3-4d364efb7a29 req-565bb009-c6dc-4725-9e9c-2efbf1de1fbc tempest-FloatingIPsAssociationTestJSON-1038327510 tempest-FloatingIPsAssociationTestJSON-1038327510-project-member] Enqueued Resource ID: da43fcb3-a053-41ce-ac92-ba868643fc4b with Priority: HIGHEST for action security_group_members [ 853.208244] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da43fcb3-a053-41ce-ac92-ba868643fc4b with Priority: HIGHEST for action security_group_members [ 853.208569] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-da43fcb3-a053-41ce-ac92-ba868643fc4b taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.208696] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.208765] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.210756] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.211070] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.211913] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.211913] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.211913] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.212089] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.212209] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da43fcb3-a053-41ce-ac92-ba868643fc4b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.220243] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.220669] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.220669] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.220669] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.220821] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.232037] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14cff10c-171f-4bbf-8531-6de5c6c7cc48 in Status: IN_PROGRESS for 2s [ 853.632554] env[68328]: INFO networking_nsxv3.common.synchronization [req-31de2481-090b-4d30-bf41-6695628d8a2e req-2a9af415-f8fb-4227-a096-f910313a7b3b tempest-AttachInterfacesTestJSON-966841523 tempest-AttachInterfacesTestJSON-966841523-project-member] Enqueued Resource ID: 76f74d16-9031-4472-a81b-f9ada0520a34 with Priority: HIGHEST for action security_group_members [ 853.633132] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76f74d16-9031-4472-a81b-f9ada0520a34 with Priority: HIGHEST for action security_group_members [ 853.633484] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-76f74d16-9031-4472-a81b-f9ada0520a34 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.633614] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76f74d16-9031-4472-a81b-f9ada0520a34" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.633693] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76f74d16-9031-4472-a81b-f9ada0520a34" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.633918] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76f74d16-9031-4472-a81b-f9ada0520a34" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.634417] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.634539] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.634539] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.634819] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.634900] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.634941] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76f74d16-9031-4472-a81b-f9ada0520a34',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.716482] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.716636] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.716765] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.716918] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.717015] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.717235] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.717519] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.717519] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.717519] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.717618] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.717694] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da43fcb3-a053-41ce-ac92-ba868643fc4b already deleted. [ 853.717744] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.780968] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-502 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.781198] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-502" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.781352] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-502" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.781704] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-502" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.781961] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.782634] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.782757] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.782941] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.783113] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.783324] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 853.783441] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 853.783641] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 853.783728] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 853.783808] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 853.783903] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 853.783983] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 853.802529] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 853.802690] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 853.803305] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 853.803305] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-502" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.803446] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-71bfa76d-3df6-40ec-840d-ce0c7943638f taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.803638] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-71bfa76d-3df6-40ec-840d-ce0c7943638f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.803758] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-71bfa76d-3df6-40ec-840d-ce0c7943638f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.804078] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-71bfa76d-3df6-40ec-840d-ce0c7943638f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.804221] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71bfa76d-3df6-40ec-840d-ce0c7943638f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.137457] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.137607] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.137676] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.137889] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.137975] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.138250] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.138430] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.138500] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.138671] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.138751] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.138843] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76f74d16-9031-4472-a81b-f9ada0520a34 is going to be updated. [ 854.165572] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.165725] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.165799] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.165956] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.166114] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.174648] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76f74d16-9031-4472-a81b-f9ada0520a34 in Status: IN_PROGRESS for 2s [ 854.307483] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.309201] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.309201] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.309364] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.310031] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.310031] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 71bfa76d-3df6-40ec-840d-ce0c7943638f not found, creating... [ 854.310031] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.310258] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.310258] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.311426] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.311426] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.311426] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.315299] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.319022] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.319022] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.319022] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.319022] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 71bfa76d-3df6-40ec-840d-ce0c7943638f is going to be created. [ 854.336721] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.337018] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.337174] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.337491] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.337734] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.337967] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-71bfa76d-3df6-40ec-840d-ce0c7943638f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.566149] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 in Status: SUCCESS [ 854.566236] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.566425] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.566661] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.566869] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.566987] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.567066] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.567226] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.567307] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.567403] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4bbd48a8-069c-43ef-b15c-47d19b8c7798',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.069695] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4bbd48a8-069c-43ef-b15c-47d19b8c7798',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.079497] env[68328]: INFO networking_nsxv3.common.synchronization [req-f19de3c3-1bc2-4ef3-8ff3-4d364efb7a29 req-6243df46-d5df-4633-8c1d-ef7febbde2d6 service nova] Enqueued Resource ID: da43fcb3-a053-41ce-ac92-ba868643fc4b with Priority: HIGHEST for action security_group_rules [ 855.079707] env[68328]: INFO networking_nsxv3.common.synchronization [req-f19de3c3-1bc2-4ef3-8ff3-4d364efb7a29 req-6243df46-d5df-4633-8c1d-ef7febbde2d6 service nova] Enqueued Resource ID: da43fcb3-a053-41ce-ac92-ba868643fc4b with Priority: HIGHEST for action security_group_members [ 855.079829] env[68328]: INFO networking_nsxv3.common.synchronization [req-f19de3c3-1bc2-4ef3-8ff3-4d364efb7a29 req-6243df46-d5df-4633-8c1d-ef7febbde2d6 service nova] Enqueued Resource ID: 71bfa76d-3df6-40ec-840d-ce0c7943638f with Priority: HIGHEST for action port [ 855.080108] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da43fcb3-a053-41ce-ac92-ba868643fc4b with Priority: HIGHEST for action security_group_rules [ 855.080246] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da43fcb3-a053-41ce-ac92-ba868643fc4b with Priority: HIGHEST for action security_group_members [ 855.080416] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71bfa76d-3df6-40ec-840d-ce0c7943638f with Priority: HIGHEST for action port [ 855.081671] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da43fcb3-a053-41ce-ac92-ba868643fc4b taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.081671] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.082319] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.082319] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.082319] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da43fcb3-a053-41ce-ac92-ba868643fc4b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.083892] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-da43fcb3-a053-41ce-ac92-ba868643fc4b taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.084055] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.084172] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.084417] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.084607] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.084754] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.084874] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.085193] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.085229] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.085324] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da43fcb3-a053-41ce-ac92-ba868643fc4b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.086198] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-71bfa76d-3df6-40ec-840d-ce0c7943638f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.086396] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71bfa76d-3df6-40ec-840d-ce0c7943638f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.086396] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71bfa76d-3df6-40ec-840d-ce0c7943638f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.086530] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71bfa76d-3df6-40ec-840d-ce0c7943638f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.086610] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71bfa76d-3df6-40ec-840d-ce0c7943638f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.241753] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14cff10c-171f-4bbf-8531-6de5c6c7cc48 in Status: SUCCESS [ 855.241939] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14cff10c-171f-4bbf-8531-6de5c6c7cc48 deletion is rescheduled due to dependency. [ 855.242070] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14cff10c-171f-4bbf-8531-6de5c6c7cc48" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.572627] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4bbd48a8-069c-43ef-b15c-47d19b8c7798',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.590837] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 71bfa76d-3df6-40ec-840d-ce0c7943638f with status ACTIVE [ 855.591176] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.591605] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.591605] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.591798] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.592047] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.592320] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.593019] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.593019] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.593019] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.593019] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.593306] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.593474] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.593585] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.593813] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.593942] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.594097] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 71bfa76d-3df6-40ec-840d-ce0c7943638f is going to be updated. [ 855.596087] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-da43fcb3-a053-41ce-ac92-ba868643fc4b taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.596087] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.596301] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('da43fcb3-a053-41ce-ac92-ba868643fc4b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.623028] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.623654] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.623779] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.623964] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.624114] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.624275] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71bfa76d-3df6-40ec-840d-ce0c7943638f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.077515] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.077684] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.077754] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.077966] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.078074] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.078173] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 is going to be updated. [ 856.100253] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('da43fcb3-a053-41ce-ac92-ba868643fc4b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.111563] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.111711] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.111793] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.112101] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.112281] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.122421] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 in Status: IN_PROGRESS for 2s [ 856.185396] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76f74d16-9031-4472-a81b-f9ada0520a34 in Status: SUCCESS [ 856.185396] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76f74d16-9031-4472-a81b-f9ada0520a34 deletion is rescheduled due to dependency. [ 856.185396] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76f74d16-9031-4472-a81b-f9ada0520a34" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.601941] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.602346] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.602346] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.602447] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.602494] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.602607] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da43fcb3-a053-41ce-ac92-ba868643fc4b is going to be created. [ 856.631487] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.631701] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.631812] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.632112] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.632352] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.643873] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da43fcb3-a053-41ce-ac92-ba868643fc4b in Status: UNINITIALIZED for 2s [ 858.132616] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 in Status: IN_PROGRESS for 4s [ 858.653704] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da43fcb3-a053-41ce-ac92-ba868643fc4b in Status: SUCCESS [ 858.653998] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.654820] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.654820] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.654820] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.654820] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.655224] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.655224] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.655224] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.655224] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.655424] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('da43fcb3-a053-41ce-ac92-ba868643fc4b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.162965] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-da43fcb3-a053-41ce-ac92-ba868643fc4b taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.162965] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.162965] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.162965] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.162965] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.162965] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.162965] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.163561] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.163561] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.163561] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.163561] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-da43fcb3-a053-41ce-ac92-ba868643fc4b taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.163561] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.163561] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.163877] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.163877] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.163877] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.163877] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.165459] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.165571] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.165644] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.165725] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('da43fcb3-a053-41ce-ac92-ba868643fc4b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.392394] env[68328]: INFO networking_nsxv3.common.synchronization [req-7d094593-be37-4ba7-bf99-342a8d376ab9 req-2e119d83-f494-44a9-a17f-2f7d0e37ac4e tempest-DeleteServersTestJSON-1696259291 tempest-DeleteServersTestJSON-1696259291-project-member] Enqueued Resource ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 with Priority: HIGHEST for action security_group_members [ 859.392846] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 with Priority: HIGHEST for action security_group_members [ 859.393181] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.393678] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.393772] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.394048] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.394377] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.394377] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.394377] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.394531] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.394593] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.394705] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c35aa45-69e7-4952-b5d8-8a7d6b3460e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.668447] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for da43fcb3-a053-41ce-ac92-ba868643fc4b: rpc.has_security_group_logging(os_id): False [ 859.687809] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.687809] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.687809] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.687809] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.687809] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.688135] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.688135] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.688135] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.688298] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.688347] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.689024] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.689024] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.689024] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.689024] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.689024] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.689654] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.689841] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.689905] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.690155] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.690196] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.690351] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da43fcb3-a053-41ce-ac92-ba868643fc4b is going to be created. [ 859.754198] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.754420] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.754482] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.754702] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.754891] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.767619] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da43fcb3-a053-41ce-ac92-ba868643fc4b in Status: IN_PROGRESS for 2s [ 859.896911] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.897087] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.897162] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.897377] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.897493] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.897711] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.897809] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.897861] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.898488] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.898628] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.898720] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 already deleted. [ 859.898804] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.143801] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 in Status: SUCCESS [ 860.144118] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.144370] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.144642] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.144881] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.145206] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.145206] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.145426] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.145562] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.145712] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.145945] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bbd48a8-069c-43ef-b15c-47d19b8c7798 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.146093] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.146201] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.146421] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.146623] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.146779] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.146888] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.147107] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.147239] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.147537] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.147776] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4bbd48a8-069c-43ef-b15c-47d19b8c7798',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.148681] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.148960] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.149018] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.149087] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.149162] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.149312] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.149391] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.149479] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4bbd48a8-069c-43ef-b15c-47d19b8c7798',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.182469] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-280 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.182799] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-280" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.182857] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-280" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.183174] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-280" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.183458] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.183625] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.183831] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.183972] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.184136] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.184353] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 860.184498] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 860.184615] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 860.184726] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 860.184838] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 860.184945] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 860.185098] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 860.202950] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 860.203160] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 860.203313] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 860.203514] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-280" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.203849] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-f669f10f-3ff1-4d12-83e7-26567914eb30 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.204112] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-f669f10f-3ff1-4d12-83e7-26567914eb30" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.204175] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-f669f10f-3ff1-4d12-83e7-26567914eb30" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.204485] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-f669f10f-3ff1-4d12-83e7-26567914eb30" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.204656] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f669f10f-3ff1-4d12-83e7-26567914eb30',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.361131] env[68328]: INFO networking_nsxv3.common.synchronization [req-4ccb9f16-af2f-4556-bc60-63d73b58652b req-a4edf307-8466-4b86-bf4c-29470fb60895 tempest-ServersTestJSON-1500344576 tempest-ServersTestJSON-1500344576-project-member] Enqueued Resource ID: e6de510a-9045-41b5-b9c0-0c2740830426 with Priority: HIGHEST for action security_group_members [ 860.361580] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6de510a-9045-41b5-b9c0-0c2740830426 with Priority: HIGHEST for action security_group_members [ 860.362144] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6de510a-9045-41b5-b9c0-0c2740830426 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.362259] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6de510a-9045-41b5-b9c0-0c2740830426" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.362322] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6de510a-9045-41b5-b9c0-0c2740830426" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.362522] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6de510a-9045-41b5-b9c0-0c2740830426" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.362666] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.362755] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.362812] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.362949] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.364020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.366429] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6de510a-9045-41b5-b9c0-0c2740830426',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.634052] env[68328]: INFO networking_nsxv3.common.synchronization [req-219deae2-1e6b-4770-859b-f8647f59d55e req-1e6b2a58-f931-45fc-8f65-fdc2f5c3f6aa tempest-AttachInterfacesUnderV243Test-835992920 tempest-AttachInterfacesUnderV243Test-835992920-project-member] Enqueued Resource ID: 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 with Priority: HIGHEST for action security_group_members [ 860.634793] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 with Priority: HIGHEST for action security_group_members [ 860.635135] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.635273] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.635859] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.635859] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.637163] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.637163] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.637163] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.637379] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.637379] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.637439] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2158d2f5-a6e7-415a-a8b1-6f8353f45cb8',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.651567] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4bbd48a8-069c-43ef-b15c-47d19b8c7798: rpc.has_security_group_logging(os_id): False [ 860.652717] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4bbd48a8-069c-43ef-b15c-47d19b8c7798',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.671589] env[68328]: INFO networking_nsxv3.common.synchronization [req-219deae2-1e6b-4770-859b-f8647f59d55e req-1e6b2a58-f931-45fc-8f65-fdc2f5c3f6aa tempest-AttachInterfacesUnderV243Test-835992920 tempest-AttachInterfacesUnderV243Test-835992920-project-member] Enqueued Resource ID: 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 with Priority: HIGHEST for action security_group_rules [ 860.671824] env[68328]: INFO networking_nsxv3.common.synchronization [req-219deae2-1e6b-4770-859b-f8647f59d55e req-1e6b2a58-f931-45fc-8f65-fdc2f5c3f6aa tempest-AttachInterfacesUnderV243Test-835992920 tempest-AttachInterfacesUnderV243Test-835992920-project-member] Enqueued Resource ID: 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 with Priority: HIGHEST for action security_group_members [ 860.672134] env[68328]: INFO networking_nsxv3.common.synchronization [req-219deae2-1e6b-4770-859b-f8647f59d55e req-1e6b2a58-f931-45fc-8f65-fdc2f5c3f6aa tempest-AttachInterfacesUnderV243Test-835992920 tempest-AttachInterfacesUnderV243Test-835992920-project-member] Enqueued Resource ID: 77fb8c9e-5fb1-4376-bf0f-26b2223c6499 with Priority: HIGHEST for action port [ 860.673496] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.673714] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.673714] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.673932] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.674019] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.674228] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.674329] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.674397] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.674561] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.674645] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.674913] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.675008] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.675078] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.675233] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.675304] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.675726] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.675726] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.675726] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.676091] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.676091] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.676091] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 is going to be created. [ 860.677521] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 with Priority: HIGHEST for action security_group_rules [ 860.677789] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 with Priority: HIGHEST for action security_group_members [ 860.677789] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77fb8c9e-5fb1-4376-bf0f-26b2223c6499 with Priority: HIGHEST for action port [ 860.678089] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.678213] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.678325] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.678903] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.678903] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2158d2f5-a6e7-415a-a8b1-6f8353f45cb8',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.679414] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.679540] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.680521] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-77fb8c9e-5fb1-4376-bf0f-26b2223c6499 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.680521] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77fb8c9e-5fb1-4376-bf0f-26b2223c6499" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.680521] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77fb8c9e-5fb1-4376-bf0f-26b2223c6499" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.680521] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77fb8c9e-5fb1-4376-bf0f-26b2223c6499" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.680521] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77fb8c9e-5fb1-4376-bf0f-26b2223c6499',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.707015] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.707511] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.707758] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.708141] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.708409] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.708670] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port f669f10f-3ff1-4d12-83e7-26567914eb30 not found, creating... [ 860.709175] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.709463] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.709712] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.710052] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.710413] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.710812] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.711115] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.711344] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.711659] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.711902] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.712168] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: f669f10f-3ff1-4d12-83e7-26567914eb30 is going to be created. [ 860.733023] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.733023] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.733023] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.733023] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.733023] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.733023] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-f669f10f-3ff1-4d12-83e7-26567914eb30" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.737224] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.737515] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.737854] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.738167] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.738458] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.748400] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 in Status: IN_PROGRESS for 2s [ 860.868366] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.868513] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.868576] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.869284] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.869284] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.869284] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.869284] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.869525] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.869525] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.869592] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.869671] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6de510a-9045-41b5-b9c0-0c2740830426 is going to be updated. [ 860.872882] env[68328]: INFO networking_nsxv3.common.synchronization [req-36898f16-dd14-4be4-be1e-ea931486f585 req-38670ac2-cb77-4107-b6c2-149c32b33fc2 tempest-ListServersNegativeTestJSON-482599207 tempest-ListServersNegativeTestJSON-482599207-project-member] Enqueued Resource ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 with Priority: HIGHEST for action security_group_members [ 860.874149] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 with Priority: HIGHEST for action security_group_members [ 860.874149] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bbd48a8-069c-43ef-b15c-47d19b8c7798 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.874321] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.920123] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.920123] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.920871] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.920871] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.920871] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.932801] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6de510a-9045-41b5-b9c0-0c2740830426 in Status: IN_PROGRESS for 2s [ 861.141836] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2158d2f5-a6e7-415a-a8b1-6f8353f45cb8',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.155116] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4bbd48a8-069c-43ef-b15c-47d19b8c7798',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.183684] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 77fb8c9e-5fb1-4376-bf0f-26b2223c6499 with status ACTIVE [ 861.183684] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.183684] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.183684] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.183684] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.183684] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.183684] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.183684] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.183684] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.183684] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.184353] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.184353] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.184353] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.184353] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.184353] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.184353] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.184353] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 77fb8c9e-5fb1-4376-bf0f-26b2223c6499 is going to be updated. [ 861.185533] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.185698] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.226773] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.227416] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.227416] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.227416] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.227624] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.227747] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77fb8c9e-5fb1-4376-bf0f-26b2223c6499" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.644060] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2158d2f5-a6e7-415a-a8b1-6f8353f45cb8',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.658517] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.658517] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.658517] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.658517] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.658517] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.658517] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 is going to be updated. [ 861.685490] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.685490] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.685490] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.685490] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.685711] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.693812] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 in Status: IN_PROGRESS for 2s [ 861.705227] env[68328]: INFO networking_nsxv3.common.synchronization [req-7d094593-be37-4ba7-bf99-342a8d376ab9 req-463a9627-c364-42e4-bd8a-0b839928ab10 service nova] Enqueued Resource ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 with Priority: HIGHEST for action security_group_rules [ 861.705403] env[68328]: INFO networking_nsxv3.common.synchronization [req-7d094593-be37-4ba7-bf99-342a8d376ab9 req-463a9627-c364-42e4-bd8a-0b839928ab10 service nova] Enqueued Resource ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 with Priority: HIGHEST for action security_group_members [ 861.705587] env[68328]: INFO networking_nsxv3.common.synchronization [req-7d094593-be37-4ba7-bf99-342a8d376ab9 req-463a9627-c364-42e4-bd8a-0b839928ab10 service nova] Enqueued Resource ID: f669f10f-3ff1-4d12-83e7-26567914eb30 with Priority: HIGHEST for action port [ 861.705820] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 with Priority: HIGHEST for action security_group_rules [ 861.705947] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 with Priority: HIGHEST for action security_group_members [ 861.706064] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f669f10f-3ff1-4d12-83e7-26567914eb30 with Priority: HIGHEST for action port [ 861.706595] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.706722] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.706788] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.708888] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.708888] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c35aa45-69e7-4952-b5d8-8a7d6b3460e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.708888] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.708888] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.708888] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.709534] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.709719] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.709791] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.709852] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.709999] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.710094] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.710183] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c35aa45-69e7-4952-b5d8-8a7d6b3460e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.715025] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-f669f10f-3ff1-4d12-83e7-26567914eb30 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.715025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f669f10f-3ff1-4d12-83e7-26567914eb30" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.715025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f669f10f-3ff1-4d12-83e7-26567914eb30" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.715025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f669f10f-3ff1-4d12-83e7-26567914eb30" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.715025] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f669f10f-3ff1-4d12-83e7-26567914eb30',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.779196] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da43fcb3-a053-41ce-ac92-ba868643fc4b in Status: SUCCESS [ 861.779612] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.857119] env[68328]: INFO networking_nsxv3.common.synchronization [req-c4ca3cd0-dccb-419b-a08e-e48fce0bcc3a req-c7dbe69d-a2c3-4a9c-8f17-c85024c21bc7 tempest-ImagesTestJSON-69996350 tempest-ImagesTestJSON-69996350-project-member] Enqueued Resource ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 with Priority: HIGHEST for action security_group_members [ 861.857894] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 with Priority: HIGHEST for action security_group_members [ 861.857982] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-249b36cf-74ee-44d9-b2c9-d728a30d9a09 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.858432] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.858824] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.858824] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.858959] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.858959] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.859758] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.859927] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.860028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.860130] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('249b36cf-74ee-44d9-b2c9-d728a30d9a09',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.151176] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.151176] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.151176] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.151176] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.151176] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.151176] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 is going to be updated. [ 862.183698] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.183977] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.183977] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.184142] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.184300] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.212077] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 in Status: IN_PROGRESS for 2s [ 862.213389] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7c35aa45-69e7-4952-b5d8-8a7d6b3460e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.215504] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.215504] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.218120] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f669f10f-3ff1-4d12-83e7-26567914eb30 with status ACTIVE [ 862.218120] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.218120] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.218354] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.218404] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.219032] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.219032] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.219032] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.219032] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.219032] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.219032] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.219310] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.219310] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.219310] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.219448] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.219523] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.219707] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f669f10f-3ff1-4d12-83e7-26567914eb30 is going to be updated. [ 862.246627] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.246797] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.246845] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.247068] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.247217] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.247376] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f669f10f-3ff1-4d12-83e7-26567914eb30" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.362972] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.363211] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.363323] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.363625] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.363705] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.363998] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.364246] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.364345] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.364573] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.364621] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.364706] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 is going to be updated. [ 862.413191] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.414139] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.414139] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.414139] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.414139] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.428279] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 in Status: IN_PROGRESS for 2s [ 862.716942] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7c35aa45-69e7-4952-b5d8-8a7d6b3460e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.762519] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 in Status: SUCCESS [ 862.762519] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.762519] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.762519] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.762519] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4bbd48a8-069c-43ef-b15c-47d19b8c7798',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.942852] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6de510a-9045-41b5-b9c0-0c2740830426 in Status: SUCCESS [ 862.943135] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6de510a-9045-41b5-b9c0-0c2740830426 deletion is rescheduled due to dependency. [ 862.943303] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6de510a-9045-41b5-b9c0-0c2740830426" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.219412] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.219743] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.219853] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.220524] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.220670] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.220838] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 is going to be created. [ 863.247207] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.247443] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.247516] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.247722] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.247877] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.258994] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 in Status: UNINITIALIZED for 2s [ 863.267254] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bbd48a8-069c-43ef-b15c-47d19b8c7798 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.267254] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.328556] env[68328]: INFO networking_nsxv3.common.synchronization [req-94962a26-7e07-430b-92ae-ec1ae243286a req-e37f3637-f140-4152-a9ab-bf77dfa1e3df tempest-AttachInterfacesUnderV243Test-835992920 tempest-AttachInterfacesUnderV243Test-835992920-project-member] Enqueued Resource ID: 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 with Priority: HIGHEST for action security_group_members [ 863.329119] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 with Priority: HIGHEST for action security_group_members [ 863.329418] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.329520] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.368803] env[68328]: INFO networking_nsxv3.common.synchronization [req-94962a26-7e07-430b-92ae-ec1ae243286a req-e37f3637-f140-4152-a9ab-bf77dfa1e3df tempest-AttachInterfacesUnderV243Test-835992920 tempest-AttachInterfacesUnderV243Test-835992920-project-member] Enqueued Resource ID: 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 with Priority: HIGHEST for action security_group_rules [ 863.368803] env[68328]: INFO networking_nsxv3.common.synchronization [req-94962a26-7e07-430b-92ae-ec1ae243286a req-e37f3637-f140-4152-a9ab-bf77dfa1e3df tempest-AttachInterfacesUnderV243Test-835992920 tempest-AttachInterfacesUnderV243Test-835992920-project-member] Enqueued Resource ID: 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 with Priority: HIGHEST for action security_group_members [ 863.368803] env[68328]: INFO networking_nsxv3.common.synchronization [req-94962a26-7e07-430b-92ae-ec1ae243286a req-e37f3637-f140-4152-a9ab-bf77dfa1e3df tempest-AttachInterfacesUnderV243Test-835992920 tempest-AttachInterfacesUnderV243Test-835992920-project-member] Enqueued Resource ID: 77fb8c9e-5fb1-4376-bf0f-26b2223c6499 with Priority: HIGHEST for action port [ 863.369041] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 with Priority: HIGHEST for action security_group_rules [ 863.369270] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 with Priority: HIGHEST for action security_group_members [ 863.369270] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77fb8c9e-5fb1-4376-bf0f-26b2223c6499 with Priority: HIGHEST for action port [ 863.369612] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.369729] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.369913] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.369995] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.370413] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-77fb8c9e-5fb1-4376-bf0f-26b2223c6499 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.370523] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77fb8c9e-5fb1-4376-bf0f-26b2223c6499" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.370587] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77fb8c9e-5fb1-4376-bf0f-26b2223c6499" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.370785] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77fb8c9e-5fb1-4376-bf0f-26b2223c6499" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.370864] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77fb8c9e-5fb1-4376-bf0f-26b2223c6499',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.704454] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 in Status: SUCCESS [ 863.704704] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.704877] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.705104] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.705294] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.705511] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.705546] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.706074] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.706074] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.706074] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4bbd48a8-069c-43ef-b15c-47d19b8c7798',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.872728] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 77fb8c9e-5fb1-4376-bf0f-26b2223c6499 with status ACTIVE [ 863.873017] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.873161] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.873230] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.873472] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.873572] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.873761] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.873859] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.873918] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.874086] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.874163] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.874480] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.874480] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.874480] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.874609] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.874678] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.874763] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 77fb8c9e-5fb1-4376-bf0f-26b2223c6499 is going to be updated. [ 863.899053] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.899053] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.899053] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.899053] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.899053] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.899053] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77fb8c9e-5fb1-4376-bf0f-26b2223c6499" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.207745] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4bbd48a8-069c-43ef-b15c-47d19b8c7798',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.229079] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 in Status: SUCCESS [ 864.229382] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.230059] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.230059] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.230059] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.230059] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.230059] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.230353] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.230353] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.230353] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2158d2f5-a6e7-415a-a8b1-6f8353f45cb8',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.439097] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 in Status: SUCCESS [ 864.439318] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 deletion is rescheduled due to dependency. [ 864.439389] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.709904] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4bbd48a8-069c-43ef-b15c-47d19b8c7798',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.732612] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2158d2f5-a6e7-415a-a8b1-6f8353f45cb8',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.212651] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.212861] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.212934] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.213165] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.213259] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.213360] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 is going to be updated. [ 865.234808] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2158d2f5-a6e7-415a-a8b1-6f8353f45cb8',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.245553] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.245701] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.245769] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.245977] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.246203] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.255724] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 in Status: IN_PROGRESS for 2s [ 865.266337] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 in Status: SUCCESS [ 865.266822] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.266822] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.266939] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.267091] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.267203] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.267272] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.267405] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.267479] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.267559] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.267644] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7c35aa45-69e7-4952-b5d8-8a7d6b3460e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.736716] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.736887] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.736993] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.737287] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.737407] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.737521] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 is going to be updated. [ 865.763837] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.764106] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.764106] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.764351] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.764530] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.769327] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.769588] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.769588] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.769778] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.769903] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.770029] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.770104] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.770236] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.770436] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.770597] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.770862] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.771012] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.771128] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.771350] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.771565] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.771711] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.771814] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.772179] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.772321] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.772527] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.772632] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7c35aa45-69e7-4952-b5d8-8a7d6b3460e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.774330] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 in Status: IN_PROGRESS for 2s [ 866.276039] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1: rpc.has_security_group_logging(os_id): False [ 866.297804] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.297953] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.298028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.298254] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.298370] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.298620] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.298696] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.298761] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.298916] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.299017] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.299199] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.299292] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.299346] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.299498] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.299569] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.299747] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.299839] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.299929] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.302160] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.302287] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.302389] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 is going to be created. [ 866.356977] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.357144] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.357217] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.357431] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.357605] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.367953] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 in Status: IN_PROGRESS for 2s [ 867.266924] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 in Status: SUCCESS [ 867.268016] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.268016] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.268016] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.268016] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.268016] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.268016] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.268467] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.268467] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.268467] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.268467] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4bbd48a8-069c-43ef-b15c-47d19b8c7798',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.519190] env[68328]: INFO networking_nsxv3.common.synchronization [req-58d6a3e8-dc22-47e6-a730-153ec41edaeb req-4e555973-6a50-4ee9-a2d5-1ba5a8f9aa92 tempest-AttachInterfacesUnderV243Test-835992920 tempest-AttachInterfacesUnderV243Test-835992920-project-member] Enqueued Resource ID: 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 with Priority: HIGHEST for action security_group_members [ 867.519798] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 with Priority: HIGHEST for action security_group_members [ 867.520087] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.520180] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.772763] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bbd48a8-069c-43ef-b15c-47d19b8c7798 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.772975] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.773050] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.773241] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.773750] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.773863] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.773929] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.774103] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.774194] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.774459] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.774543] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bbd48a8-069c-43ef-b15c-47d19b8c7798 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.774839] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.774914] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.775079] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.775221] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.775313] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.775373] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.775925] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.776122] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.776188] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.776278] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4bbd48a8-069c-43ef-b15c-47d19b8c7798',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.786147] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 in Status: SUCCESS [ 867.786350] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.786507] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.786701] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.786891] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.787042] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.787114] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.787269] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.787347] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.787435] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.787533] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2158d2f5-a6e7-415a-a8b1-6f8353f45cb8',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.788783] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.788951] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.789117] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.789398] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.789398] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.789398] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.789539] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.789575] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2158d2f5-a6e7-415a-a8b1-6f8353f45cb8',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.282494] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4bbd48a8-069c-43ef-b15c-47d19b8c7798: rpc.has_security_group_logging(os_id): False [ 868.291622] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2158d2f5-a6e7-415a-a8b1-6f8353f45cb8',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.292640] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.292764] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.292827] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.293035] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.301363] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.301505] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.318595] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.318853] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.318967] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.319093] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.319306] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.319357] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.319452] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 is going to be updated. [ 868.320361] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.320550] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.320643] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.324021] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.324021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.324021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.324021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.324021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.324021] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.324021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.324021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.324021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.324021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.324021] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.324021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.324021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.324021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.324645] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.324645] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 is going to be updated. [ 868.349296] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.349638] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.349747] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.350016] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.350215] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.359435] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 in Status: IN_PROGRESS for 2s [ 868.384508] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 in Status: SUCCESS [ 868.384508] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.384508] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.384508] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.384508] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.384508] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.384508] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.399731] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 in Status: IN_PROGRESS for 2s [ 868.801352] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8: rpc.has_security_group_logging(os_id): False [ 868.819161] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.819313] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.819386] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.819604] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.819699] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.819951] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.820063] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.820122] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.820271] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.820370] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.820469] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 is going to be updated. [ 868.876888] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.877370] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.877370] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.877370] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.877574] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.891900] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 in Status: IN_PROGRESS for 2s [ 870.364980] env[68328]: INFO networking_nsxv3.common.synchronization [req-83f62908-3b7c-42ff-8c2c-eec1cdb0805f req-fe8a196b-2f97-4fed-b7e3-6201e16ba25c tempest-ServersAdminTestJSON-340534059 tempest-ServersAdminTestJSON-340534059-project-member] Enqueued Resource ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed with Priority: HIGHEST for action security_group_members [ 870.365567] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed with Priority: HIGHEST for action security_group_members [ 870.366211] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.366397] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.366469] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.366844] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.366844] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.367322] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.367387] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.369095] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.369095] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.369095] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.373859] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 in Status: SUCCESS [ 870.374037] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 deletion is rescheduled due to dependency. [ 870.374141] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.375709] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.375934] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.376080] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.376193] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.376268] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.376459] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.376459] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.378959] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2158d2f5-a6e7-415a-a8b1-6f8353f45cb8',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.411349] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 in Status: SUCCESS [ 870.411349] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.411588] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.411588] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.411675] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4bbd48a8-069c-43ef-b15c-47d19b8c7798',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.872055] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.881548] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.881548] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.881670] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.881842] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.881937] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.882157] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.882257] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.882319] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.882528] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.882631] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.882756] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 is going to be updated. [ 870.907399] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 in Status: SUCCESS [ 870.907722] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.908992] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.908992] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.909226] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2158d2f5-a6e7-415a-a8b1-6f8353f45cb8',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.910930] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.911055] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.911100] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.914062] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.914062] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.918669] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bbd48a8-069c-43ef-b15c-47d19b8c7798 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.918669] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.918669] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.918669] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.918669] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.918669] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.918669] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.918669] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.918669] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.918669] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.918669] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4bbd48a8-069c-43ef-b15c-47d19b8c7798',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.923753] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 in Status: IN_PROGRESS for 2s [ 871.375375] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.423635] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bbd48a8-069c-43ef-b15c-47d19b8c7798 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.423786] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.423861] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.424916] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.425125] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.425235] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.425298] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.425469] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.425993] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.426641] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.426641] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bbd48a8-069c-43ef-b15c-47d19b8c7798 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.427605] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.427691] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.427994] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.427994] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.428146] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.428181] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.428307] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.428384] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.428909] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.428909] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4bbd48a8-069c-43ef-b15c-47d19b8c7798',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.434106] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.434106] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.434106] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.434106] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.434106] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.434106] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 is going to be deleted. [ 871.481795] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.481795] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.481795] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.481795] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.481795] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.481795] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.879615] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.879615] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.879615] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.879615] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.879615] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.879615] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed is going to be updated. [ 871.912547] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.912718] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.912808] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.913031] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.913176] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.922343] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed in Status: IN_PROGRESS for 2s [ 871.938181] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4bbd48a8-069c-43ef-b15c-47d19b8c7798: rpc.has_security_group_logging(os_id): False [ 871.952451] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.953287] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.953408] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.953721] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.953818] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.954064] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.954320] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.954320] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.954865] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.954865] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.954865] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.954865] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.954865] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.955105] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.955139] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.956026] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.956026] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.956026] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.956026] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.956026] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.956026] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 is going to be updated. [ 872.012101] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.012315] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.012404] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.012651] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.013156] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.028913] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 in Status: IN_PROGRESS for 2s [ 872.034672] env[68328]: INFO networking_nsxv3.common.synchronization [None req-8e204d38-d90a-4b03-894a-968fc0cac2c0 None None] Enqueued Resource ID: 22261be9-ffb9-4506-a9bd-09e7d7d13a26 with Priority: HIGHEST for action port [ 872.035237] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22261be9-ffb9-4506-a9bd-09e7d7d13a26 with Priority: HIGHEST for action port [ 872.035541] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-22261be9-ffb9-4506-a9bd-09e7d7d13a26 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.035664] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-22261be9-ffb9-4506-a9bd-09e7d7d13a26" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.035729] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-22261be9-ffb9-4506-a9bd-09e7d7d13a26" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.035976] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-22261be9-ffb9-4506-a9bd-09e7d7d13a26" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.038125] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22261be9-ffb9-4506-a9bd-09e7d7d13a26',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.459055] env[68328]: INFO networking_nsxv3.common.synchronization [req-2df47891-f9e2-46c1-a026-24bb6a06a524 req-3f2cd6a2-9b47-4625-a037-0fd411fb06b4 tempest-DeleteServersTestJSON-1696259291 tempest-DeleteServersTestJSON-1696259291-project-member] Enqueued Resource ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 with Priority: HIGHEST for action security_group_members [ 872.459539] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 with Priority: HIGHEST for action security_group_members [ 872.462836] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.462836] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.462836] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.462836] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.462836] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.462836] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.462836] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.462836] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.462836] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.462836] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c35aa45-69e7-4952-b5d8-8a7d6b3460e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.540933] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 22261be9-ffb9-4506-a9bd-09e7d7d13a26 [ 872.540933] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.540933] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.540933] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.540933] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.540933] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.540933] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:22261be9-ffb9-4506-a9bd-09e7d7d13a26 already deleted. [ 872.540933] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-22261be9-ffb9-4506-a9bd-09e7d7d13a26" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.941320] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 in Status: SUCCESS [ 872.941320] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 deletion is rescheduled due to dependency. [ 872.941320] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.941320] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.941320] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.941320] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.941320] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.941320] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.941320] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.941320] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.941320] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2158d2f5-a6e7-415a-a8b1-6f8353f45cb8',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.965882] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.966044] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.966116] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.966336] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.966434] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.966669] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.966751] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.966813] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.966994] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.967077] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.967162] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 is going to be updated. [ 872.991424] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.991582] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.991655] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.991826] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.991955] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.999188] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 in Status: IN_PROGRESS for 2s [ 873.446340] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.446340] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.446340] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.446340] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.446634] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.446634] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.446731] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.446731] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.446884] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.446946] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.447017] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2158d2f5-a6e7-415a-a8b1-6f8353f45cb8 is going to be deleted. [ 873.473771] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.474066] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.474066] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.474368] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.474368] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.474466] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2158d2f5-a6e7-415a-a8b1-6f8353f45cb8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.931990] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed in Status: SUCCESS [ 873.932231] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.042998] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 in Status: SUCCESS [ 874.042998] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.328908] env[68328]: INFO networking_nsxv3.common.synchronization [None req-067b5497-067a-4b7b-a838-c9e9fcedc863 None None] Enqueued Resource ID: aad51d12-50c5-4093-b771-5ae2716c0bd8 with Priority: HIGHEST for action port [ 874.329200] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aad51d12-50c5-4093-b771-5ae2716c0bd8 with Priority: HIGHEST for action port [ 874.329817] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-aad51d12-50c5-4093-b771-5ae2716c0bd8 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.330769] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aad51d12-50c5-4093-b771-5ae2716c0bd8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.330769] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aad51d12-50c5-4093-b771-5ae2716c0bd8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.330769] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aad51d12-50c5-4093-b771-5ae2716c0bd8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.330769] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aad51d12-50c5-4093-b771-5ae2716c0bd8',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.835808] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aad51d12-50c5-4093-b771-5ae2716c0bd8 [ 874.836085] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.836201] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.836291] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.836543] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.836664] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.836759] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aad51d12-50c5-4093-b771-5ae2716c0bd8 already deleted. [ 874.836832] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aad51d12-50c5-4093-b771-5ae2716c0bd8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.964335] env[68328]: INFO networking_nsxv3.common.synchronization [None req-c9eb5a12-7619-4898-baf1-567268be8d81 tempest-ImagesOneServerNegativeTestJSON-288072164 tempest-ImagesOneServerNegativeTestJSON-288072164-project-member] Enqueued Resource ID: 06640ad5-75a2-45fc-91bc-0d1e4e0075a5 with Priority: HIGHEST for action security_group_rules [ 874.964855] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06640ad5-75a2-45fc-91bc-0d1e4e0075a5 with Priority: HIGHEST for action security_group_rules [ 874.965161] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06640ad5-75a2-45fc-91bc-0d1e4e0075a5 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.965278] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06640ad5-75a2-45fc-91bc-0d1e4e0075a5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.965340] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06640ad5-75a2-45fc-91bc-0d1e4e0075a5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.966879] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06640ad5-75a2-45fc-91bc-0d1e4e0075a5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.967202] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06640ad5-75a2-45fc-91bc-0d1e4e0075a5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.008102] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 in Status: SUCCESS [ 875.008283] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 deletion is rescheduled due to dependency. [ 875.008398] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.126056] env[68328]: INFO networking_nsxv3.common.synchronization [None req-0f086c16-d0d2-4090-8e6a-11c1927cf9de None None] Enqueued Resource ID: 73d87bac-55d1-4af9-9e32-1eddad918f15 with Priority: HIGHEST for action port [ 875.126631] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73d87bac-55d1-4af9-9e32-1eddad918f15 with Priority: HIGHEST for action port [ 875.127052] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-73d87bac-55d1-4af9-9e32-1eddad918f15 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.127344] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73d87bac-55d1-4af9-9e32-1eddad918f15" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.127344] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73d87bac-55d1-4af9-9e32-1eddad918f15" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.127491] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73d87bac-55d1-4af9-9e32-1eddad918f15" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.127573] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73d87bac-55d1-4af9-9e32-1eddad918f15',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.150597] env[68328]: INFO networking_nsxv3.common.synchronization [None req-f1689c49-d831-4b05-aba2-e4d15a737b2c tempest-ImagesOneServerNegativeTestJSON-288072164 tempest-ImagesOneServerNegativeTestJSON-288072164-project-member] Enqueued Resource ID: 06640ad5-75a2-45fc-91bc-0d1e4e0075a5 with Priority: HIGHEST for action security_group_rules [ 875.151283] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06640ad5-75a2-45fc-91bc-0d1e4e0075a5 with Priority: HIGHEST for action security_group_rules [ 875.151590] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06640ad5-75a2-45fc-91bc-0d1e4e0075a5 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.151688] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06640ad5-75a2-45fc-91bc-0d1e4e0075a5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.487980] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.488153] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.488292] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.488426] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.488645] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.488645] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06640ad5-75a2-45fc-91bc-0d1e4e0075a5 already deleted. [ 875.488719] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06640ad5-75a2-45fc-91bc-0d1e4e0075a5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.492016] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06640ad5-75a2-45fc-91bc-0d1e4e0075a5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.492016] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06640ad5-75a2-45fc-91bc-0d1e4e0075a5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.492016] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06640ad5-75a2-45fc-91bc-0d1e4e0075a5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.631112] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 73d87bac-55d1-4af9-9e32-1eddad918f15 [ 875.631376] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.631543] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.631607] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.631798] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.631883] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.632695] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:73d87bac-55d1-4af9-9e32-1eddad918f15 already deleted. [ 875.632695] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73d87bac-55d1-4af9-9e32-1eddad918f15" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.011049] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.011338] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.011338] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.011640] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.011640] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.011640] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06640ad5-75a2-45fc-91bc-0d1e4e0075a5 already deleted. [ 876.011780] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06640ad5-75a2-45fc-91bc-0d1e4e0075a5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.636884] env[68328]: INFO networking_nsxv3.common.synchronization [None req-02f5f535-84e0-4467-bc6a-418de6f2cc26 None None] Enqueued Resource ID: c8bc98ad-ac30-4ef8-9d03-3246d7c22638 with Priority: HIGHEST for action port [ 876.637377] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8bc98ad-ac30-4ef8-9d03-3246d7c22638 with Priority: HIGHEST for action port [ 876.637675] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-c8bc98ad-ac30-4ef8-9d03-3246d7c22638 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.637781] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c8bc98ad-ac30-4ef8-9d03-3246d7c22638" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.637866] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c8bc98ad-ac30-4ef8-9d03-3246d7c22638" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.638615] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c8bc98ad-ac30-4ef8-9d03-3246d7c22638" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.638615] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8bc98ad-ac30-4ef8-9d03-3246d7c22638',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.141400] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c8bc98ad-ac30-4ef8-9d03-3246d7c22638 [ 877.141672] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.141672] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.141770] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.141916] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.142015] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.143467] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c8bc98ad-ac30-4ef8-9d03-3246d7c22638 already deleted. [ 877.143574] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c8bc98ad-ac30-4ef8-9d03-3246d7c22638" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.373177] env[68328]: INFO networking_nsxv3.common.synchronization [None req-979e5658-2686-45a6-b1ac-1cd06031a5a9 None None] Enqueued Resource ID: f24740b8-63bc-4f39-a3a4-1913c5b04c21 with Priority: HIGHEST for action port [ 877.373432] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f24740b8-63bc-4f39-a3a4-1913c5b04c21 with Priority: HIGHEST for action port [ 877.373999] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-f24740b8-63bc-4f39-a3a4-1913c5b04c21 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.374143] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f24740b8-63bc-4f39-a3a4-1913c5b04c21" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.374215] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f24740b8-63bc-4f39-a3a4-1913c5b04c21" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.374462] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f24740b8-63bc-4f39-a3a4-1913c5b04c21" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.374548] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f24740b8-63bc-4f39-a3a4-1913c5b04c21',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.878427] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f24740b8-63bc-4f39-a3a4-1913c5b04c21 [ 877.878659] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.878793] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.878870] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.879083] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.879175] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.879269] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f24740b8-63bc-4f39-a3a4-1913c5b04c21 already deleted. [ 877.879348] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f24740b8-63bc-4f39-a3a4-1913c5b04c21" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.498545] env[68328]: INFO networking_nsxv3.common.synchronization [None req-4c542f12-39e7-47d6-8165-de94ef69be12 None None] Enqueued Resource ID: 0f8ee7a0-05d3-444a-9f25-ad183af1f8b1 with Priority: HIGHEST for action port [ 880.498545] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f8ee7a0-05d3-444a-9f25-ad183af1f8b1 with Priority: HIGHEST for action port [ 880.499413] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f8ee7a0-05d3-444a-9f25-ad183af1f8b1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.499413] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f8ee7a0-05d3-444a-9f25-ad183af1f8b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.499413] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f8ee7a0-05d3-444a-9f25-ad183af1f8b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.499871] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f8ee7a0-05d3-444a-9f25-ad183af1f8b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.499871] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f8ee7a0-05d3-444a-9f25-ad183af1f8b1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.005841] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0f8ee7a0-05d3-444a-9f25-ad183af1f8b1 [ 881.006495] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.006646] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.006710] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.006904] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.007017] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.007115] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0f8ee7a0-05d3-444a-9f25-ad183af1f8b1 already deleted. [ 881.007216] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f8ee7a0-05d3-444a-9f25-ad183af1f8b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.256558] env[68328]: INFO networking_nsxv3.common.synchronization [None req-938f31d4-3573-4e15-a4cc-4b1ac32ea38b None None] Enqueued Resource ID: 9b160a56-3e7a-4a0f-8cf5-875b85f3189d with Priority: HIGHEST for action port [ 882.257413] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b160a56-3e7a-4a0f-8cf5-875b85f3189d with Priority: HIGHEST for action port [ 882.258054] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b160a56-3e7a-4a0f-8cf5-875b85f3189d taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.258171] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b160a56-3e7a-4a0f-8cf5-875b85f3189d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.258235] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b160a56-3e7a-4a0f-8cf5-875b85f3189d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.258905] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b160a56-3e7a-4a0f-8cf5-875b85f3189d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.258992] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b160a56-3e7a-4a0f-8cf5-875b85f3189d',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.761245] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9b160a56-3e7a-4a0f-8cf5-875b85f3189d [ 882.761514] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.761664] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.761735] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.761944] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.762048] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.762151] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9b160a56-3e7a-4a0f-8cf5-875b85f3189d already deleted. [ 882.762229] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b160a56-3e7a-4a0f-8cf5-875b85f3189d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.083400] env[68328]: INFO networking_nsxv3.common.synchronization [req-0b5bd9f6-3631-4ffb-9bad-f9a3369dc17f req-10846e90-83f7-4dcd-b10f-1daf4243b48d tempest-SecurityGroupsTestJSON-429138018 tempest-SecurityGroupsTestJSON-429138018-project-member] Enqueued Resource ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 with Priority: HIGHEST for action security_group_members [ 885.083734] env[68328]: INFO networking_nsxv3.common.synchronization [req-0b5bd9f6-3631-4ffb-9bad-f9a3369dc17f req-10846e90-83f7-4dcd-b10f-1daf4243b48d tempest-SecurityGroupsTestJSON-429138018 tempest-SecurityGroupsTestJSON-429138018-project-member] Enqueued Resource ID: c897dadb-95bc-4de7-a117-d38870fbace8 with Priority: HIGHEST for action security_group_members [ 885.083734] env[68328]: INFO networking_nsxv3.common.synchronization [req-0b5bd9f6-3631-4ffb-9bad-f9a3369dc17f req-10846e90-83f7-4dcd-b10f-1daf4243b48d tempest-SecurityGroupsTestJSON-429138018 tempest-SecurityGroupsTestJSON-429138018-project-member] Enqueued Resource ID: 8f95f28e-3c21-415e-9067-7aef8eff10d3 with Priority: HIGHEST for action security_group_members [ 885.084296] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 with Priority: HIGHEST for action security_group_members [ 885.084437] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c897dadb-95bc-4de7-a117-d38870fbace8 with Priority: HIGHEST for action security_group_members [ 885.084643] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f95f28e-3c21-415e-9067-7aef8eff10d3 with Priority: HIGHEST for action security_group_members [ 885.084803] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-870ec36b-ba1d-4422-a26d-1328f51f79e4 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.084921] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.084989] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.085194] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.085342] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.085450] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.085552] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.085637] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.085721] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.085813] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.087097] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-c897dadb-95bc-4de7-a117-d38870fbace8 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.087207] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c897dadb-95bc-4de7-a117-d38870fbace8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.087274] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c897dadb-95bc-4de7-a117-d38870fbace8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.087534] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c897dadb-95bc-4de7-a117-d38870fbace8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.087694] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.087793] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.087853] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.087994] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.088086] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.088172] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c897dadb-95bc-4de7-a117-d38870fbace8',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.089344] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f95f28e-3c21-415e-9067-7aef8eff10d3 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.089344] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f95f28e-3c21-415e-9067-7aef8eff10d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.089758] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f95f28e-3c21-415e-9067-7aef8eff10d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.089758] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f95f28e-3c21-415e-9067-7aef8eff10d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.089873] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.089873] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.089997] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.090077] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.090154] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.090237] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f95f28e-3c21-415e-9067-7aef8eff10d3',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.588394] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.588648] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.588724] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.588934] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.589059] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.589241] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.589351] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.589414] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.589566] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.589643] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.589725] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 is going to be updated. [ 885.590979] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.591103] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.591156] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.591309] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.592256] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.592348] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.611294] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.611636] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.611794] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.611883] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.612193] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.612305] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.612429] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c897dadb-95bc-4de7-a117-d38870fbace8 is going to be updated. [ 885.613775] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.614023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.614158] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.614515] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.614515] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.614742] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.614797] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.614905] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.614989] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f95f28e-3c21-415e-9067-7aef8eff10d3 is going to be updated. [ 885.625820] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.625958] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.626028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.626201] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.626334] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.633109] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 in Status: IN_PROGRESS for 2s [ 885.642545] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.642656] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.642746] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.642968] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.643066] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.644500] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.644610] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.644694] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.644827] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.644938] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.653232] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c897dadb-95bc-4de7-a117-d38870fbace8 in Status: IN_PROGRESS for 2s [ 885.654033] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f95f28e-3c21-415e-9067-7aef8eff10d3 in Status: IN_PROGRESS for 2s [ 887.645544] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 in Status: SUCCESS [ 887.645544] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 deletion is rescheduled due to dependency. [ 887.645544] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.666904] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c897dadb-95bc-4de7-a117-d38870fbace8 in Status: SUCCESS [ 887.667113] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c897dadb-95bc-4de7-a117-d38870fbace8 deletion is rescheduled due to dependency. [ 887.667227] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c897dadb-95bc-4de7-a117-d38870fbace8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.667978] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f95f28e-3c21-415e-9067-7aef8eff10d3 in Status: SUCCESS [ 887.668187] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f95f28e-3c21-415e-9067-7aef8eff10d3 deletion is rescheduled due to dependency. [ 887.668314] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f95f28e-3c21-415e-9067-7aef8eff10d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.086735] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 890.086735] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 891.176032] env[68328]: INFO networking_nsxv3.common.synchronization [req-2e0c129e-2f11-4517-8d79-b4c62cfaa750 req-46ef5da9-4016-4257-bbba-4b42624a37fb tempest-AttachVolumeTestJSON-972540760 tempest-AttachVolumeTestJSON-972540760-project-member] Enqueued Resource ID: e50e8525-9eb2-4aff-9a46-c4c1621d14db with Priority: HIGHEST for action security_group_members [ 891.176588] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e50e8525-9eb2-4aff-9a46-c4c1621d14db with Priority: HIGHEST for action security_group_members [ 891.176859] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-e50e8525-9eb2-4aff-9a46-c4c1621d14db taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.176987] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e50e8525-9eb2-4aff-9a46-c4c1621d14db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.178134] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e50e8525-9eb2-4aff-9a46-c4c1621d14db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.178458] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e50e8525-9eb2-4aff-9a46-c4c1621d14db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.178647] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.178765] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.178931] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.179030] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.179281] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.179281] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e50e8525-9eb2-4aff-9a46-c4c1621d14db',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.449758] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-587 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.449965] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-587" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.450106] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-587" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.450448] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-587" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.450757] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.450918] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.451212] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.451463] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.451619] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.451837] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 891.451954] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 891.452139] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 891.452257] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 891.452375] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 891.452486] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 891.452622] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 891.472625] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 891.472787] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 891.472928] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 891.473112] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-587" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.473439] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-fef153f6-c93e-47cf-87d0-e3942ad22c85 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.473584] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-fef153f6-c93e-47cf-87d0-e3942ad22c85" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.473713] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-fef153f6-c93e-47cf-87d0-e3942ad22c85" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.474008] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-fef153f6-c93e-47cf-87d0-e3942ad22c85" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.474160] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fef153f6-c93e-47cf-87d0-e3942ad22c85',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.682048] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.682237] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.682289] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.682521] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.682598] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.682832] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.682903] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.682963] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.683125] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.683196] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.683280] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e50e8525-9eb2-4aff-9a46-c4c1621d14db already deleted. [ 891.683391] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e50e8525-9eb2-4aff-9a46-c4c1621d14db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.978048] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.978048] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.978048] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.978048] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.978324] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.978372] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port fef153f6-c93e-47cf-87d0-e3942ad22c85 not found, creating... [ 891.978617] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.978778] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.978896] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.979131] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.979271] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.979553] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.979712] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.979829] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.980045] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.980186] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.980335] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: fef153f6-c93e-47cf-87d0-e3942ad22c85 is going to be created. [ 891.999286] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.999477] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.999607] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.999854] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.000087] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.000319] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-fef153f6-c93e-47cf-87d0-e3942ad22c85" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.675596] env[68328]: INFO networking_nsxv3.common.synchronization [req-2e0c129e-2f11-4517-8d79-b4c62cfaa750 req-ff32b791-f4e2-439f-903a-894e2ece55a2 service nova] Enqueued Resource ID: e50e8525-9eb2-4aff-9a46-c4c1621d14db with Priority: HIGHEST for action security_group_rules [ 892.675893] env[68328]: INFO networking_nsxv3.common.synchronization [req-2e0c129e-2f11-4517-8d79-b4c62cfaa750 req-ff32b791-f4e2-439f-903a-894e2ece55a2 service nova] Enqueued Resource ID: e50e8525-9eb2-4aff-9a46-c4c1621d14db with Priority: HIGHEST for action security_group_members [ 892.675893] env[68328]: INFO networking_nsxv3.common.synchronization [req-2e0c129e-2f11-4517-8d79-b4c62cfaa750 req-ff32b791-f4e2-439f-903a-894e2ece55a2 service nova] Enqueued Resource ID: fef153f6-c93e-47cf-87d0-e3942ad22c85 with Priority: HIGHEST for action port [ 892.676156] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e50e8525-9eb2-4aff-9a46-c4c1621d14db with Priority: HIGHEST for action security_group_rules [ 892.676314] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e50e8525-9eb2-4aff-9a46-c4c1621d14db with Priority: HIGHEST for action security_group_members [ 892.676368] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fef153f6-c93e-47cf-87d0-e3942ad22c85 with Priority: HIGHEST for action port [ 892.679918] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e50e8525-9eb2-4aff-9a46-c4c1621d14db taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.680081] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e50e8525-9eb2-4aff-9a46-c4c1621d14db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.680148] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e50e8525-9eb2-4aff-9a46-c4c1621d14db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.680350] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e50e8525-9eb2-4aff-9a46-c4c1621d14db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.680983] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e50e8525-9eb2-4aff-9a46-c4c1621d14db',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.681306] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-e50e8525-9eb2-4aff-9a46-c4c1621d14db taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.681415] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e50e8525-9eb2-4aff-9a46-c4c1621d14db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.681492] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e50e8525-9eb2-4aff-9a46-c4c1621d14db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.681665] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e50e8525-9eb2-4aff-9a46-c4c1621d14db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.681809] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.681900] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.681962] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.682158] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.682244] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.682332] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e50e8525-9eb2-4aff-9a46-c4c1621d14db',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.685472] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-fef153f6-c93e-47cf-87d0-e3942ad22c85 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.685472] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fef153f6-c93e-47cf-87d0-e3942ad22c85" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.685472] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fef153f6-c93e-47cf-87d0-e3942ad22c85" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.685472] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fef153f6-c93e-47cf-87d0-e3942ad22c85" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.685472] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fef153f6-c93e-47cf-87d0-e3942ad22c85',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.186045] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e50e8525-9eb2-4aff-9a46-c4c1621d14db',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.187144] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-e50e8525-9eb2-4aff-9a46-c4c1621d14db taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.188129] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e50e8525-9eb2-4aff-9a46-c4c1621d14db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.188129] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fef153f6-c93e-47cf-87d0-e3942ad22c85 with status ACTIVE [ 893.188129] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.188129] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.188129] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.188129] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.188362] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.188388] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.188511] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.188572] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.188731] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.188809] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.188982] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.189103] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.189159] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.189320] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.189374] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.189449] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fef153f6-c93e-47cf-87d0-e3942ad22c85 is going to be updated. [ 893.208524] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.208698] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.208733] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.208900] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.209040] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.209197] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fef153f6-c93e-47cf-87d0-e3942ad22c85" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.658303] env[68328]: INFO networking_nsxv3.common.synchronization [req-5651c574-9331-4b02-a459-983881c74180 req-166165d2-3cc7-4367-9274-99bcd35c7342 tempest-VolumesAdminNegativeTest-207194333 tempest-VolumesAdminNegativeTest-207194333-project-member] Enqueued Resource ID: ce9938d1-497b-4835-b26f-069491d36e2e with Priority: HIGHEST for action security_group_members [ 893.658896] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce9938d1-497b-4835-b26f-069491d36e2e with Priority: HIGHEST for action security_group_members [ 893.659266] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce9938d1-497b-4835-b26f-069491d36e2e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.659516] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce9938d1-497b-4835-b26f-069491d36e2e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.659516] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce9938d1-497b-4835-b26f-069491d36e2e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.659763] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce9938d1-497b-4835-b26f-069491d36e2e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.661462] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.661462] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.661462] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.661462] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.661462] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.661462] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce9938d1-497b-4835-b26f-069491d36e2e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.688444] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e50e8525-9eb2-4aff-9a46-c4c1621d14db',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.162879] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.163090] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.163144] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.163332] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.163418] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.163617] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.163737] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.163801] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.163948] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.164056] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.164142] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce9938d1-497b-4835-b26f-069491d36e2e already deleted. [ 894.164221] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce9938d1-497b-4835-b26f-069491d36e2e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.191348] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.191492] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.191580] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.191768] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.191853] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.191950] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e50e8525-9eb2-4aff-9a46-c4c1621d14db is going to be created. [ 894.219163] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.219446] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.219446] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.219583] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.219737] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.231065] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e50e8525-9eb2-4aff-9a46-c4c1621d14db in Status: UNINITIALIZED for 2s [ 894.286713] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-614 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.286713] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-614" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.287135] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-614" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.287412] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-614" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.287741] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.288186] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.288186] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.288303] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.288354] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.288555] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 894.289063] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 894.289063] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 894.289063] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 894.289063] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 894.289201] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 894.289228] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 894.336513] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 894.336701] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.047 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 894.336842] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 894.337054] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-614" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.337383] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-e6b386ca-6580-404d-abfa-590a1abd0c37 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.337556] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-e6b386ca-6580-404d-abfa-590a1abd0c37" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.337678] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-e6b386ca-6580-404d-abfa-590a1abd0c37" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.337991] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-e6b386ca-6580-404d-abfa-590a1abd0c37" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.338149] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6b386ca-6580-404d-abfa-590a1abd0c37',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.840831] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.841150] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.841214] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.841488] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.841671] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.841831] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port e6b386ca-6580-404d-abfa-590a1abd0c37 not found, creating... [ 894.842100] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.842260] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.842380] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.842599] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.842741] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.843024] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.843186] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.843310] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.843507] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.843705] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.843775] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: e6b386ca-6580-404d-abfa-590a1abd0c37 is going to be created. [ 894.862246] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.862464] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.862811] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.862982] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.863248] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.863505] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-e6b386ca-6580-404d-abfa-590a1abd0c37" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.511015] env[68328]: INFO networking_nsxv3.common.synchronization [req-5651c574-9331-4b02-a459-983881c74180 req-bdb970ef-b0c0-4a17-b6bc-bbb76ee80f93 service nova] Enqueued Resource ID: ce9938d1-497b-4835-b26f-069491d36e2e with Priority: HIGHEST for action security_group_rules [ 895.511214] env[68328]: INFO networking_nsxv3.common.synchronization [req-5651c574-9331-4b02-a459-983881c74180 req-bdb970ef-b0c0-4a17-b6bc-bbb76ee80f93 service nova] Enqueued Resource ID: ce9938d1-497b-4835-b26f-069491d36e2e with Priority: HIGHEST for action security_group_members [ 895.511358] env[68328]: INFO networking_nsxv3.common.synchronization [req-5651c574-9331-4b02-a459-983881c74180 req-bdb970ef-b0c0-4a17-b6bc-bbb76ee80f93 service nova] Enqueued Resource ID: e6b386ca-6580-404d-abfa-590a1abd0c37 with Priority: HIGHEST for action port [ 895.511593] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce9938d1-497b-4835-b26f-069491d36e2e with Priority: HIGHEST for action security_group_rules [ 895.511723] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce9938d1-497b-4835-b26f-069491d36e2e with Priority: HIGHEST for action security_group_members [ 895.511816] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6b386ca-6580-404d-abfa-590a1abd0c37 with Priority: HIGHEST for action port [ 895.512362] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ce9938d1-497b-4835-b26f-069491d36e2e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.512479] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ce9938d1-497b-4835-b26f-069491d36e2e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.512546] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ce9938d1-497b-4835-b26f-069491d36e2e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.512901] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ce9938d1-497b-4835-b26f-069491d36e2e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.512981] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ce9938d1-497b-4835-b26f-069491d36e2e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.515674] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce9938d1-497b-4835-b26f-069491d36e2e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.515674] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce9938d1-497b-4835-b26f-069491d36e2e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.515674] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce9938d1-497b-4835-b26f-069491d36e2e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.515674] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce9938d1-497b-4835-b26f-069491d36e2e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.515674] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.515674] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.515674] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.515674] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.515674] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.515674] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce9938d1-497b-4835-b26f-069491d36e2e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.520169] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-e6b386ca-6580-404d-abfa-590a1abd0c37 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.520169] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e6b386ca-6580-404d-abfa-590a1abd0c37" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.520169] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e6b386ca-6580-404d-abfa-590a1abd0c37" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.520169] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e6b386ca-6580-404d-abfa-590a1abd0c37" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.520169] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6b386ca-6580-404d-abfa-590a1abd0c37',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.019214] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce9938d1-497b-4835-b26f-069491d36e2e taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.019902] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce9938d1-497b-4835-b26f-069491d36e2e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.019902] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ce9938d1-497b-4835-b26f-069491d36e2e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.022768] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e6b386ca-6580-404d-abfa-590a1abd0c37 with status ACTIVE [ 896.022768] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.022768] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.022768] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.022768] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.022768] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.022768] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.023122] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.023122] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.023209] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.023293] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.023741] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.023873] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.023934] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.024094] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.024165] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.024247] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e6b386ca-6580-404d-abfa-590a1abd0c37 is going to be updated. [ 896.044241] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.044384] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.044455] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.044645] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.044776] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.044926] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e6b386ca-6580-404d-abfa-590a1abd0c37" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.246644] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e50e8525-9eb2-4aff-9a46-c4c1621d14db in Status: SUCCESS [ 896.246865] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e50e8525-9eb2-4aff-9a46-c4c1621d14db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.247044] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e50e8525-9eb2-4aff-9a46-c4c1621d14db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.247638] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e50e8525-9eb2-4aff-9a46-c4c1621d14db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.247638] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.247638] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.247638] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.247831] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.247987] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.248121] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e50e8525-9eb2-4aff-9a46-c4c1621d14db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.248217] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e50e8525-9eb2-4aff-9a46-c4c1621d14db',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.323838] env[68328]: INFO networking_nsxv3.common.synchronization [req-f909253f-4b28-48e4-87d2-e979036b81f2 req-07a28ce9-299f-40ff-857c-2afae1795926 tempest-AttachVolumeShelveTestJSON-1223620556 tempest-AttachVolumeShelveTestJSON-1223620556-project-member] Enqueued Resource ID: 551b86cb-6c17-4238-9ac7-89fd77e1e91b with Priority: HIGHEST for action security_group_members [ 896.324390] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 551b86cb-6c17-4238-9ac7-89fd77e1e91b with Priority: HIGHEST for action security_group_members [ 896.324698] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-551b86cb-6c17-4238-9ac7-89fd77e1e91b taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.324819] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-551b86cb-6c17-4238-9ac7-89fd77e1e91b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.324879] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-551b86cb-6c17-4238-9ac7-89fd77e1e91b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.325263] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-551b86cb-6c17-4238-9ac7-89fd77e1e91b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.325424] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.325527] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.325582] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.325739] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.325821] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.325910] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('551b86cb-6c17-4238-9ac7-89fd77e1e91b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.523112] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ce9938d1-497b-4835-b26f-069491d36e2e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.694842] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-194 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.695190] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-194" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.695849] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-194" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.696334] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-194" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.696758] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.697076] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.697672] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.698031] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.698790] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.699326] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 896.700069] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 896.700224] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 896.700356] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 896.701189] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 896.701411] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 896.701535] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 896.722114] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 896.722114] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 896.722114] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 896.722114] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-194" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.722114] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-8ce900df-4c92-47b2-a21e-bd310cf26c5d taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.722114] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-8ce900df-4c92-47b2-a21e-bd310cf26c5d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.722114] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-8ce900df-4c92-47b2-a21e-bd310cf26c5d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.722114] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-8ce900df-4c92-47b2-a21e-bd310cf26c5d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.722114] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ce900df-4c92-47b2-a21e-bd310cf26c5d',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.750788] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e50e8525-9eb2-4aff-9a46-c4c1621d14db',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.828731] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.828870] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.828933] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.829162] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.829250] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.829446] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.829559] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.829660] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.829840] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.829921] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.830025] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 551b86cb-6c17-4238-9ac7-89fd77e1e91b already deleted. [ 896.830108] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-551b86cb-6c17-4238-9ac7-89fd77e1e91b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.025363] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.025739] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.025739] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.025826] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.025858] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.025959] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce9938d1-497b-4835-b26f-069491d36e2e is going to be created. [ 897.048085] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.048308] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.048439] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.048726] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.048958] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.057569] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce9938d1-497b-4835-b26f-069491d36e2e in Status: UNINITIALIZED for 2s [ 897.228619] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.228886] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.229150] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.229345] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.229536] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.229923] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 8ce900df-4c92-47b2-a21e-bd310cf26c5d not found, creating... [ 897.230123] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.230309] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.230473] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.230775] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.230941] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.231288] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.231497] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.231981] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.231981] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.232135] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.232171] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 8ce900df-4c92-47b2-a21e-bd310cf26c5d is going to be created. [ 897.253160] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e50e8525-9eb2-4aff-9a46-c4c1621d14db: rpc.has_security_group_logging(os_id): False [ 897.265131] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.265356] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.265487] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.265759] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.265988] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.266229] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-8ce900df-4c92-47b2-a21e-bd310cf26c5d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.270058] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.270399] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.270399] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.270487] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.270632] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.270802] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.270916] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.270964] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.271135] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.271211] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.271297] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e50e8525-9eb2-4aff-9a46-c4c1621d14db is going to be created. [ 897.334017] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.334017] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.334017] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.334017] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.334295] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.360652] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e50e8525-9eb2-4aff-9a46-c4c1621d14db in Status: IN_PROGRESS for 2s [ 898.082360] env[68328]: INFO networking_nsxv3.common.synchronization [req-f909253f-4b28-48e4-87d2-e979036b81f2 req-16f811ae-7f3c-479e-b75c-175de2356dd5 service nova] Enqueued Resource ID: 551b86cb-6c17-4238-9ac7-89fd77e1e91b with Priority: HIGHEST for action security_group_rules [ 898.082360] env[68328]: INFO networking_nsxv3.common.synchronization [req-f909253f-4b28-48e4-87d2-e979036b81f2 req-16f811ae-7f3c-479e-b75c-175de2356dd5 service nova] Enqueued Resource ID: 551b86cb-6c17-4238-9ac7-89fd77e1e91b with Priority: HIGHEST for action security_group_members [ 898.082360] env[68328]: INFO networking_nsxv3.common.synchronization [req-f909253f-4b28-48e4-87d2-e979036b81f2 req-16f811ae-7f3c-479e-b75c-175de2356dd5 service nova] Enqueued Resource ID: 8ce900df-4c92-47b2-a21e-bd310cf26c5d with Priority: HIGHEST for action port [ 898.083175] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 551b86cb-6c17-4238-9ac7-89fd77e1e91b with Priority: HIGHEST for action security_group_rules [ 898.083175] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 551b86cb-6c17-4238-9ac7-89fd77e1e91b with Priority: HIGHEST for action security_group_members [ 898.083304] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ce900df-4c92-47b2-a21e-bd310cf26c5d with Priority: HIGHEST for action port [ 898.087020] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-551b86cb-6c17-4238-9ac7-89fd77e1e91b taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.087020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-551b86cb-6c17-4238-9ac7-89fd77e1e91b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.087020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-551b86cb-6c17-4238-9ac7-89fd77e1e91b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.087020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-551b86cb-6c17-4238-9ac7-89fd77e1e91b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.087020] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('551b86cb-6c17-4238-9ac7-89fd77e1e91b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.087020] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-551b86cb-6c17-4238-9ac7-89fd77e1e91b taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.087020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-551b86cb-6c17-4238-9ac7-89fd77e1e91b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.087020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-551b86cb-6c17-4238-9ac7-89fd77e1e91b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.087020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-551b86cb-6c17-4238-9ac7-89fd77e1e91b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.087020] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.087020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.087020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.087020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.087020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.087733] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('551b86cb-6c17-4238-9ac7-89fd77e1e91b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.088376] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ce900df-4c92-47b2-a21e-bd310cf26c5d taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.088519] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ce900df-4c92-47b2-a21e-bd310cf26c5d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.088610] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ce900df-4c92-47b2-a21e-bd310cf26c5d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.088778] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ce900df-4c92-47b2-a21e-bd310cf26c5d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.088833] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ce900df-4c92-47b2-a21e-bd310cf26c5d',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.591038] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-551b86cb-6c17-4238-9ac7-89fd77e1e91b taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.591187] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-551b86cb-6c17-4238-9ac7-89fd77e1e91b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.593633] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8ce900df-4c92-47b2-a21e-bd310cf26c5d with status ACTIVE [ 898.593848] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.593995] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.594055] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.594251] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.594339] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.594523] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.594620] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.594682] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.594835] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.594911] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.595106] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.595199] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.595252] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.595389] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.595462] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.595543] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8ce900df-4c92-47b2-a21e-bd310cf26c5d is going to be updated. [ 898.596618] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('551b86cb-6c17-4238-9ac7-89fd77e1e91b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.617029] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.617158] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.617229] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.617410] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.617538] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.617686] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ce900df-4c92-47b2-a21e-bd310cf26c5d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.068092] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce9938d1-497b-4835-b26f-069491d36e2e in Status: SUCCESS [ 899.068703] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce9938d1-497b-4835-b26f-069491d36e2e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.068703] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce9938d1-497b-4835-b26f-069491d36e2e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.068703] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce9938d1-497b-4835-b26f-069491d36e2e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.068943] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.069118] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.069209] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.069390] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.069495] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.069604] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce9938d1-497b-4835-b26f-069491d36e2e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.069714] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ce9938d1-497b-4835-b26f-069491d36e2e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.098676] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('551b86cb-6c17-4238-9ac7-89fd77e1e91b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.371821] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e50e8525-9eb2-4aff-9a46-c4c1621d14db in Status: SUCCESS [ 899.371955] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e50e8525-9eb2-4aff-9a46-c4c1621d14db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.573775] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce9938d1-497b-4835-b26f-069491d36e2e taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.573962] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce9938d1-497b-4835-b26f-069491d36e2e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.574034] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce9938d1-497b-4835-b26f-069491d36e2e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.574293] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce9938d1-497b-4835-b26f-069491d36e2e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.574468] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.574572] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.574637] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.574789] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.574874] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.574961] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce9938d1-497b-4835-b26f-069491d36e2e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.575142] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce9938d1-497b-4835-b26f-069491d36e2e taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.575234] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce9938d1-497b-4835-b26f-069491d36e2e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.575294] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce9938d1-497b-4835-b26f-069491d36e2e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.575431] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce9938d1-497b-4835-b26f-069491d36e2e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.575562] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.575651] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.575709] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.575840] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.575927] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.576017] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce9938d1-497b-4835-b26f-069491d36e2e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.576121] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ce9938d1-497b-4835-b26f-069491d36e2e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.602910] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.602910] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.602910] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.602910] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.602910] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.602910] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 551b86cb-6c17-4238-9ac7-89fd77e1e91b is going to be created. [ 899.631062] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.631062] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.631062] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.631062] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.631062] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.639469] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 551b86cb-6c17-4238-9ac7-89fd77e1e91b in Status: UNINITIALIZED for 2s [ 900.079155] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ce9938d1-497b-4835-b26f-069491d36e2e: rpc.has_security_group_logging(os_id): False [ 900.098439] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.098573] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.098642] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.098853] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.100058] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.100058] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.100058] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.100058] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.100058] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.100058] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.100058] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.100058] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.100058] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.100760] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.100760] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.100760] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.100760] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.100760] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.100760] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.101070] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.101070] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ce9938d1-497b-4835-b26f-069491d36e2e is going to be created. [ 900.167606] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.167765] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.167859] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.168088] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.168282] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.178741] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce9938d1-497b-4835-b26f-069491d36e2e in Status: IN_PROGRESS for 2s [ 901.045020] env[68328]: INFO networking_nsxv3.common.synchronization [req-6be3884a-cb08-48e5-8853-50123d8206b8 req-074276b1-90fd-4104-8a00-5395d3d23e2b tempest-ServerActionsTestOtherB-24837534 tempest-ServerActionsTestOtherB-24837534-project-member] Enqueued Resource ID: 54390b69-5280-4540-a63f-fa4daae4a11f with Priority: HIGHEST for action security_group_members [ 901.045020] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54390b69-5280-4540-a63f-fa4daae4a11f with Priority: HIGHEST for action security_group_members [ 901.045020] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-54390b69-5280-4540-a63f-fa4daae4a11f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.045020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.045020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.045020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.046553] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.046794] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.050644] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.050644] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.050644] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.050644] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54390b69-5280-4540-a63f-fa4daae4a11f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.237022] env[68328]: INFO networking_nsxv3.common.synchronization [req-ffbab45a-a334-4429-942b-9213d52f899a req-119a9fa0-56a9-481c-8aa0-c145d5ea7aa8 tempest-ListImageFiltersTestJSON-876538757 tempest-ListImageFiltersTestJSON-876538757-project-member] Enqueued Resource ID: d160efa7-0312-433f-b94f-cf7e99e24473 with Priority: HIGHEST for action security_group_members [ 901.237022] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d160efa7-0312-433f-b94f-cf7e99e24473 with Priority: HIGHEST for action security_group_members [ 901.237022] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-d160efa7-0312-433f-b94f-cf7e99e24473 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.237022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.237022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.237022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.237022] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.237022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.237695] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.237931] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.238135] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.238308] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d160efa7-0312-433f-b94f-cf7e99e24473',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.410147] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-507 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.410147] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-507" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.410147] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-507" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.410147] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-507" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.410147] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.410147] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.410147] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.410147] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.410147] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.410759] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 901.410988] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 901.411203] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 901.411398] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 901.411616] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 901.411814] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 901.412044] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 901.433438] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 901.433438] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 901.433438] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 901.433438] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-507" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.433438] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-edea6d9b-b45c-4c2e-823e-e246a5ea1dc0 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.433438] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-edea6d9b-b45c-4c2e-823e-e246a5ea1dc0" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.433438] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-edea6d9b-b45c-4c2e-823e-e246a5ea1dc0" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.433438] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-edea6d9b-b45c-4c2e-823e-e246a5ea1dc0" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.433438] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('edea6d9b-b45c-4c2e-823e-e246a5ea1dc0',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.551691] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.551895] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.551963] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.552225] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.552319] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.552521] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.552629] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.552693] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.552844] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.552918] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.553008] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54390b69-5280-4540-a63f-fa4daae4a11f already deleted. [ 901.553103] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.650819] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 551b86cb-6c17-4238-9ac7-89fd77e1e91b in Status: SUCCESS [ 901.651045] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-551b86cb-6c17-4238-9ac7-89fd77e1e91b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.651209] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-551b86cb-6c17-4238-9ac7-89fd77e1e91b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.652587] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-551b86cb-6c17-4238-9ac7-89fd77e1e91b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.652587] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.652587] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.652587] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.652587] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.652587] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.652587] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-551b86cb-6c17-4238-9ac7-89fd77e1e91b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.652587] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('551b86cb-6c17-4238-9ac7-89fd77e1e91b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.740912] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.741070] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.741152] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.741356] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.741433] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.741637] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.741739] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.741780] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.741915] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.741994] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.742095] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d160efa7-0312-433f-b94f-cf7e99e24473 is going to be updated. [ 901.766188] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.766360] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.766401] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.766704] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.766800] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.774447] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d160efa7-0312-433f-b94f-cf7e99e24473 in Status: IN_PROGRESS for 2s [ 901.934735] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.935023] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.935177] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.935457] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.935614] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.935777] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port edea6d9b-b45c-4c2e-823e-e246a5ea1dc0 not found, creating... [ 901.936043] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.936207] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.936327] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.936552] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.936692] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.936972] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.937140] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.937261] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.937460] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.937619] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.937773] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: edea6d9b-b45c-4c2e-823e-e246a5ea1dc0 is going to be created. [ 901.957692] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.958130] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.959761] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.960029] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.960294] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.960526] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-edea6d9b-b45c-4c2e-823e-e246a5ea1dc0" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.156261] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('551b86cb-6c17-4238-9ac7-89fd77e1e91b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.195556] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce9938d1-497b-4835-b26f-069491d36e2e in Status: SUCCESS [ 902.195556] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ce9938d1-497b-4835-b26f-069491d36e2e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.658926] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 551b86cb-6c17-4238-9ac7-89fd77e1e91b: rpc.has_security_group_logging(os_id): False [ 902.680928] env[68328]: INFO networking_nsxv3.common.synchronization [req-6be3884a-cb08-48e5-8853-50123d8206b8 req-7e4ae1c2-35bf-4cc3-828c-e17dd9d3f97c service nova] Enqueued Resource ID: 54390b69-5280-4540-a63f-fa4daae4a11f with Priority: HIGHEST for action security_group_rules [ 902.681144] env[68328]: INFO networking_nsxv3.common.synchronization [req-6be3884a-cb08-48e5-8853-50123d8206b8 req-7e4ae1c2-35bf-4cc3-828c-e17dd9d3f97c service nova] Enqueued Resource ID: 54390b69-5280-4540-a63f-fa4daae4a11f with Priority: HIGHEST for action security_group_members [ 902.681292] env[68328]: INFO networking_nsxv3.common.synchronization [req-6be3884a-cb08-48e5-8853-50123d8206b8 req-7e4ae1c2-35bf-4cc3-828c-e17dd9d3f97c service nova] Enqueued Resource ID: edea6d9b-b45c-4c2e-823e-e246a5ea1dc0 with Priority: HIGHEST for action port [ 902.682438] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.682844] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.682844] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.682844] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.682926] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.683166] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.683267] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.683333] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.683488] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.683566] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.683656] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 551b86cb-6c17-4238-9ac7-89fd77e1e91b is going to be created. [ 902.685257] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54390b69-5280-4540-a63f-fa4daae4a11f with Priority: HIGHEST for action security_group_rules [ 902.685349] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54390b69-5280-4540-a63f-fa4daae4a11f with Priority: HIGHEST for action security_group_members [ 902.685436] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edea6d9b-b45c-4c2e-823e-e246a5ea1dc0 with Priority: HIGHEST for action port [ 902.685742] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54390b69-5280-4540-a63f-fa4daae4a11f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.685857] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.685857] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.685985] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.686091] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54390b69-5280-4540-a63f-fa4daae4a11f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.686929] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-54390b69-5280-4540-a63f-fa4daae4a11f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.687049] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.687102] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.687254] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.687398] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.687494] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.687545] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.687693] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.687786] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.687821] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54390b69-5280-4540-a63f-fa4daae4a11f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.688764] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-edea6d9b-b45c-4c2e-823e-e246a5ea1dc0 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.688764] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-edea6d9b-b45c-4c2e-823e-e246a5ea1dc0" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.688876] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-edea6d9b-b45c-4c2e-823e-e246a5ea1dc0" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.691570] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-edea6d9b-b45c-4c2e-823e-e246a5ea1dc0" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.691570] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('edea6d9b-b45c-4c2e-823e-e246a5ea1dc0',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.747916] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.748090] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.748205] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.748404] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.748647] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.760380] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 551b86cb-6c17-4238-9ac7-89fd77e1e91b in Status: IN_PROGRESS for 2s [ 903.193239] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-54390b69-5280-4540-a63f-fa4daae4a11f taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.193239] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.193239] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port edea6d9b-b45c-4c2e-823e-e246a5ea1dc0 with status ACTIVE [ 903.193239] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.193239] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.193239] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.193239] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.193239] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.193239] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.193239] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.193239] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.193239] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.193239] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.193748] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.193748] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.193748] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.193748] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.193748] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.193748] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: edea6d9b-b45c-4c2e-823e-e246a5ea1dc0 is going to be updated. [ 903.194787] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('54390b69-5280-4540-a63f-fa4daae4a11f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.228025] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.228930] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.228930] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.228930] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.228930] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.228930] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-edea6d9b-b45c-4c2e-823e-e246a5ea1dc0" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.701231] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('54390b69-5280-4540-a63f-fa4daae4a11f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.785457] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d160efa7-0312-433f-b94f-cf7e99e24473 in Status: SUCCESS [ 903.785639] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d160efa7-0312-433f-b94f-cf7e99e24473 deletion is rescheduled due to dependency. [ 903.785753] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.202546] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.202703] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.202783] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.203110] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.203208] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.203311] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54390b69-5280-4540-a63f-fa4daae4a11f is going to be created. [ 904.227908] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.228083] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.228149] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.228444] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.228707] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.238971] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54390b69-5280-4540-a63f-fa4daae4a11f in Status: UNINITIALIZED for 2s [ 904.776333] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 551b86cb-6c17-4238-9ac7-89fd77e1e91b in Status: SUCCESS [ 904.776591] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-551b86cb-6c17-4238-9ac7-89fd77e1e91b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.943060] env[68328]: INFO networking_nsxv3.common.synchronization [None req-95ba0bc6-9315-4fc3-aef8-96c14d4a30f0 tempest-AttachInterfacesTestJSON-966841523 tempest-AttachInterfacesTestJSON-966841523-project-member] Enqueued Resource ID: 0c5088e7-0ed1-4112-b902-8fd593a8b34e with Priority: HIGHEST for action security_group_rules [ 905.943576] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c5088e7-0ed1-4112-b902-8fd593a8b34e with Priority: HIGHEST for action security_group_rules [ 905.943910] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c5088e7-0ed1-4112-b902-8fd593a8b34e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.944040] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c5088e7-0ed1-4112-b902-8fd593a8b34e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.944102] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c5088e7-0ed1-4112-b902-8fd593a8b34e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.944341] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c5088e7-0ed1-4112-b902-8fd593a8b34e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.944420] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c5088e7-0ed1-4112-b902-8fd593a8b34e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.062345] env[68328]: INFO networking_nsxv3.common.synchronization [None req-08d54922-8cca-4a57-aa9b-ce1b8309cf9b tempest-AttachInterfacesTestJSON-966841523 tempest-AttachInterfacesTestJSON-966841523-project-member] Enqueued Resource ID: 0c5088e7-0ed1-4112-b902-8fd593a8b34e with Priority: HIGHEST for action security_group_rules [ 906.063592] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c5088e7-0ed1-4112-b902-8fd593a8b34e with Priority: HIGHEST for action security_group_rules [ 906.063592] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c5088e7-0ed1-4112-b902-8fd593a8b34e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.063592] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c5088e7-0ed1-4112-b902-8fd593a8b34e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.250310] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54390b69-5280-4540-a63f-fa4daae4a11f in Status: SUCCESS [ 906.250551] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.250949] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.251220] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.251404] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.251521] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.251587] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.251890] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.252015] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.252110] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.252204] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('54390b69-5280-4540-a63f-fa4daae4a11f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.463902] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.464078] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.464143] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.464319] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.464407] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.464503] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c5088e7-0ed1-4112-b902-8fd593a8b34e already deleted. [ 906.464693] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c5088e7-0ed1-4112-b902-8fd593a8b34e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.464757] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c5088e7-0ed1-4112-b902-8fd593a8b34e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.464874] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c5088e7-0ed1-4112-b902-8fd593a8b34e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.465018] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c5088e7-0ed1-4112-b902-8fd593a8b34e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.754816] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('54390b69-5280-4540-a63f-fa4daae4a11f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.985763] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.986194] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.986194] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.986303] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.986440] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.986596] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c5088e7-0ed1-4112-b902-8fd593a8b34e already deleted. [ 906.986725] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c5088e7-0ed1-4112-b902-8fd593a8b34e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.257445] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 54390b69-5280-4540-a63f-fa4daae4a11f: rpc.has_security_group_logging(os_id): False [ 907.275414] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.275564] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.275631] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.276075] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.276075] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.276216] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.276316] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.276380] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.276530] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.276606] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.276692] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54390b69-5280-4540-a63f-fa4daae4a11f is going to be created. [ 907.331125] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.331125] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.331125] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.331125] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.331298] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.341301] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54390b69-5280-4540-a63f-fa4daae4a11f in Status: IN_PROGRESS for 2s [ 908.448842] env[68328]: INFO networking_nsxv3.common.synchronization [None req-4cc4fd76-f0c7-4ccd-8b6e-07aa9510f687 None None] Enqueued Resource ID: 79774def-19ed-441b-a42b-7e1839b6dcf4 with Priority: HIGHEST for action port [ 908.449412] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79774def-19ed-441b-a42b-7e1839b6dcf4 with Priority: HIGHEST for action port [ 908.449722] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-79774def-19ed-441b-a42b-7e1839b6dcf4 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.449864] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79774def-19ed-441b-a42b-7e1839b6dcf4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.449932] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79774def-19ed-441b-a42b-7e1839b6dcf4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.453295] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79774def-19ed-441b-a42b-7e1839b6dcf4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.453295] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79774def-19ed-441b-a42b-7e1839b6dcf4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.503802] env[68328]: INFO networking_nsxv3.common.synchronization [req-d86f725d-3ed5-4b1b-b98f-fd362ee4e3db req-a2553415-2795-4212-8109-1d9badecb6d3 tempest-ImagesTestJSON-69996350 tempest-ImagesTestJSON-69996350-project-member] Enqueued Resource ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 with Priority: HIGHEST for action security_group_members [ 908.504319] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 with Priority: HIGHEST for action security_group_members [ 908.504627] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-249b36cf-74ee-44d9-b2c9-d728a30d9a09 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.504750] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.504820] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.505030] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.505193] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.506557] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.506557] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.506557] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.506557] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.506557] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('249b36cf-74ee-44d9-b2c9-d728a30d9a09',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.926491] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-834 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.926683] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-834" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.927494] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-834" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.927863] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-834" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.928184] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.928364] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.928487] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.928822] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.929012] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.929245] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 908.929362] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 908.929473] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 908.929581] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 908.929695] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 908.929804] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 908.929946] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 908.948482] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 908.948570] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 908.948746] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 908.948938] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-834" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.949794] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-401e3867-f612-49ae-a7dd-df183ce3a989 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.949794] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-401e3867-f612-49ae-a7dd-df183ce3a989" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.949794] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-401e3867-f612-49ae-a7dd-df183ce3a989" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.950102] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-401e3867-f612-49ae-a7dd-df183ce3a989" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.950102] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('401e3867-f612-49ae-a7dd-df183ce3a989',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.955528] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 79774def-19ed-441b-a42b-7e1839b6dcf4 [ 908.955528] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.955528] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.955528] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.955528] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.955528] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.955850] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:79774def-19ed-441b-a42b-7e1839b6dcf4 already deleted. [ 908.955850] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79774def-19ed-441b-a42b-7e1839b6dcf4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.010992] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.010992] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.010992] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.010992] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.010992] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.010992] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.010992] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.010992] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.010992] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.010992] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.010992] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 is going to be updated. [ 909.032423] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.033698] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.034145] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.035745] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.035745] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.042818] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 in Status: IN_PROGRESS for 2s [ 909.353212] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54390b69-5280-4540-a63f-fa4daae4a11f in Status: SUCCESS [ 909.353212] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.401311] env[68328]: INFO networking_nsxv3.common.synchronization [None req-798190f2-43b5-44de-91e1-1757d81373a0 tempest-ServerActionsTestOtherA-501294167 tempest-ServerActionsTestOtherA-501294167-project-member] Enqueued Resource ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 with Priority: HIGHEST for action security_group_rules [ 909.401916] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 with Priority: HIGHEST for action security_group_rules [ 909.402252] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-35b651ef-47c8-4ff2-b472-9849f375b8c9 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.402377] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.402445] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.402699] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.402785] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('35b651ef-47c8-4ff2-b472-9849f375b8c9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.455343] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.455343] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.455343] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.455343] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.455343] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.455343] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 401e3867-f612-49ae-a7dd-df183ce3a989 not found, creating... [ 909.455343] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.455343] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.455343] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.455343] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.455343] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.456571] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.458155] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.458331] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.458581] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.458804] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.458963] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 401e3867-f612-49ae-a7dd-df183ce3a989 is going to be created. [ 909.481617] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.481617] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.481617] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.481617] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.481617] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.481617] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-401e3867-f612-49ae-a7dd-df183ce3a989" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.528321] env[68328]: INFO networking_nsxv3.common.synchronization [None req-5e49a221-149e-4e4d-b527-9b58b6019211 tempest-ServerActionsTestOtherA-501294167 tempest-ServerActionsTestOtherA-501294167-project-member] Enqueued Resource ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 with Priority: HIGHEST for action security_group_rules [ 909.528321] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 with Priority: HIGHEST for action security_group_rules [ 909.529992] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-35b651ef-47c8-4ff2-b472-9849f375b8c9 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.530265] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.924547] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.924840] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.924840] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.927167] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.927167] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.927167] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 already deleted. [ 909.927167] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.927167] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.927167] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.927167] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('35b651ef-47c8-4ff2-b472-9849f375b8c9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.389758] env[68328]: INFO networking_nsxv3.common.synchronization [req-d86f725d-3ed5-4b1b-b98f-fd362ee4e3db req-289c0937-0abb-42eb-b37b-48d1a81aa408 service nova] Enqueued Resource ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 with Priority: HIGHEST for action security_group_rules [ 910.389758] env[68328]: INFO networking_nsxv3.common.synchronization [req-d86f725d-3ed5-4b1b-b98f-fd362ee4e3db req-289c0937-0abb-42eb-b37b-48d1a81aa408 service nova] Enqueued Resource ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 with Priority: HIGHEST for action security_group_members [ 910.389935] env[68328]: INFO networking_nsxv3.common.synchronization [req-d86f725d-3ed5-4b1b-b98f-fd362ee4e3db req-289c0937-0abb-42eb-b37b-48d1a81aa408 service nova] Enqueued Resource ID: 401e3867-f612-49ae-a7dd-df183ce3a989 with Priority: HIGHEST for action port [ 910.390432] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 with Priority: HIGHEST for action security_group_rules [ 910.390560] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 with Priority: HIGHEST for action security_group_members [ 910.390668] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 401e3867-f612-49ae-a7dd-df183ce3a989 with Priority: HIGHEST for action port [ 910.390972] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-249b36cf-74ee-44d9-b2c9-d728a30d9a09 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.391096] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.391158] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.391356] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.391432] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('249b36cf-74ee-44d9-b2c9-d728a30d9a09',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.392272] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-249b36cf-74ee-44d9-b2c9-d728a30d9a09 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.392356] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.393028] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-401e3867-f612-49ae-a7dd-df183ce3a989 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.393135] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-401e3867-f612-49ae-a7dd-df183ce3a989" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.393176] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-401e3867-f612-49ae-a7dd-df183ce3a989" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.393332] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-401e3867-f612-49ae-a7dd-df183ce3a989" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.393575] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('401e3867-f612-49ae-a7dd-df183ce3a989',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.446752] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.446752] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.447596] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.447596] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.447596] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.447596] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 already deleted. [ 910.447596] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.895633] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 401e3867-f612-49ae-a7dd-df183ce3a989 with status ACTIVE [ 910.895918] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.896079] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.896132] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.896356] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.896464] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.896659] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.896768] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.896827] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.896984] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.897075] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.897272] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.897442] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.897442] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.897617] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.897671] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.897709] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 401e3867-f612-49ae-a7dd-df183ce3a989 is going to be updated. [ 910.899749] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-249b36cf-74ee-44d9-b2c9-d728a30d9a09 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.899862] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.910444] env[68328]: INFO networking_nsxv3.common.synchronization [None req-67c17119-0b95-4849-b62c-9cce79d28fd3 None None] Enqueued Resource ID: ca3af638-4076-425e-8266-7717030565d6 with Priority: HIGHEST for action port [ 910.911623] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca3af638-4076-425e-8266-7717030565d6 with Priority: HIGHEST for action port [ 910.913368] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca3af638-4076-425e-8266-7717030565d6 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.913368] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca3af638-4076-425e-8266-7717030565d6" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.913368] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca3af638-4076-425e-8266-7717030565d6" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.913497] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca3af638-4076-425e-8266-7717030565d6" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.913823] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca3af638-4076-425e-8266-7717030565d6',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.918349] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.918471] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.918585] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.918729] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.918857] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.919015] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-401e3867-f612-49ae-a7dd-df183ce3a989" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.980808] env[68328]: INFO networking_nsxv3.common.synchronization [req-ac454a4b-af62-4b5a-aad8-3f9d6628a5ec req-9bb2ab75-818c-4f6f-8b1b-9a06c6c2be31 tempest-VolumesAdminNegativeTest-207194333 tempest-VolumesAdminNegativeTest-207194333-project-member] Enqueued Resource ID: ce9938d1-497b-4835-b26f-069491d36e2e with Priority: HIGHEST for action security_group_members [ 910.981315] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce9938d1-497b-4835-b26f-069491d36e2e with Priority: HIGHEST for action security_group_members [ 910.981616] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce9938d1-497b-4835-b26f-069491d36e2e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.981740] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce9938d1-497b-4835-b26f-069491d36e2e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.981798] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce9938d1-497b-4835-b26f-069491d36e2e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.981991] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce9938d1-497b-4835-b26f-069491d36e2e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.982737] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.982868] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.982950] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.983140] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.983249] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.983371] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce9938d1-497b-4835-b26f-069491d36e2e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.053158] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 in Status: SUCCESS [ 911.053537] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 deletion is rescheduled due to dependency. [ 911.053700] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.054238] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.054407] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.054760] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.054760] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.054868] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.055020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.055020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.055126] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('249b36cf-74ee-44d9-b2c9-d728a30d9a09',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.417185] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ca3af638-4076-425e-8266-7717030565d6 [ 911.417880] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.418856] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.418998] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.419289] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.419412] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.419557] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ca3af638-4076-425e-8266-7717030565d6 already deleted. [ 911.419652] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca3af638-4076-425e-8266-7717030565d6" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.485603] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.485774] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.485846] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.486120] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.486221] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.486761] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.486761] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.486761] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.486761] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.487048] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.487048] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce9938d1-497b-4835-b26f-069491d36e2e is going to be updated. [ 911.510411] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.510603] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.510603] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.510928] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.511106] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.521086] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce9938d1-497b-4835-b26f-069491d36e2e in Status: IN_PROGRESS for 2s [ 911.559071] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('249b36cf-74ee-44d9-b2c9-d728a30d9a09',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.062505] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('249b36cf-74ee-44d9-b2c9-d728a30d9a09',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.563944] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.564196] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.564249] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.564506] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.564506] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.564624] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 is going to be updated. [ 912.592042] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.592042] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.592279] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.592324] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.592446] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.601267] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 in Status: IN_PROGRESS for 2s [ 913.530885] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce9938d1-497b-4835-b26f-069491d36e2e in Status: SUCCESS [ 913.531173] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce9938d1-497b-4835-b26f-069491d36e2e deletion is rescheduled due to dependency. [ 913.531216] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce9938d1-497b-4835-b26f-069491d36e2e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.611310] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 in Status: SUCCESS [ 914.611732] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.611732] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.611987] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.612202] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.612323] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.612388] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.612556] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.612639] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.612722] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.612821] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('249b36cf-74ee-44d9-b2c9-d728a30d9a09',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.119594] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-249b36cf-74ee-44d9-b2c9-d728a30d9a09 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.119594] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.119594] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.119807] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.119807] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.119924] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.119999] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.120186] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.120291] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.120396] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.120565] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-249b36cf-74ee-44d9-b2c9-d728a30d9a09 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.120675] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.120859] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.121255] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.121419] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.121529] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.121593] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.121732] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.121810] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.121889] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.121977] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('249b36cf-74ee-44d9-b2c9-d728a30d9a09',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.623873] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 249b36cf-74ee-44d9-b2c9-d728a30d9a09: rpc.has_security_group_logging(os_id): False [ 915.641375] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.641555] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.641603] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.641824] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.641917] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.642124] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.642218] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.642273] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.642425] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.642498] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.642743] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.642855] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.642918] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.643162] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.643239] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.643429] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.643522] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.643584] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.643722] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.644255] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.644255] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 is going to be updated. [ 915.700923] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.701169] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.701169] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.701343] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.701483] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.717127] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 in Status: IN_PROGRESS for 2s [ 915.938327] env[68328]: INFO networking_nsxv3.common.synchronization [req-d130fbb1-33e9-42bb-8233-f12f12ead2f1 req-894201b2-fc86-4adb-a40a-fba9dca766d9 tempest-ListServersNegativeTestJSON-482599207 tempest-ListServersNegativeTestJSON-482599207-project-member] Enqueued Resource ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 with Priority: HIGHEST for action security_group_members [ 915.939035] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 with Priority: HIGHEST for action security_group_members [ 915.939119] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bbd48a8-069c-43ef-b15c-47d19b8c7798 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.940508] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.940508] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.940508] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.940508] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.940508] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.940508] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.940508] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.940508] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.940508] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4bbd48a8-069c-43ef-b15c-47d19b8c7798',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.964034] env[68328]: INFO networking_nsxv3.common.synchronization [req-d0db7812-1727-479d-a43a-40e7b7a8b737 req-04878aa7-7274-448a-9daa-c11feddf3ddc tempest-ListServersNegativeTestJSON-482599207 tempest-ListServersNegativeTestJSON-482599207-project-member] Enqueued Resource ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 with Priority: HIGHEST for action security_group_members [ 915.964273] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 with Priority: HIGHEST for action security_group_members [ 915.964827] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bbd48a8-069c-43ef-b15c-47d19b8c7798 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.964932] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.444028] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.444028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.444028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.444028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.444028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.444028] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.444028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.444028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.444492] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.444492] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.444492] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 is going to be updated. [ 916.471055] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.471055] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.471055] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.471263] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.471263] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.479186] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 in Status: IN_PROGRESS for 2s [ 916.887238] env[68328]: INFO networking_nsxv3.common.synchronization [req-a2056e91-6a2c-4913-b0bc-253623f4c2c7 req-c49c62bb-92d2-43cb-b890-3f4c2c64472b tempest-FloatingIPsAssociationTestJSON-1038327510 tempest-FloatingIPsAssociationTestJSON-1038327510-project-member] Enqueued Resource ID: da43fcb3-a053-41ce-ac92-ba868643fc4b with Priority: HIGHEST for action security_group_members [ 916.887627] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da43fcb3-a053-41ce-ac92-ba868643fc4b with Priority: HIGHEST for action security_group_members [ 916.887934] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-da43fcb3-a053-41ce-ac92-ba868643fc4b taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.888070] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.888138] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.888337] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.888757] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.888757] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.888757] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.888897] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.888897] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.888995] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da43fcb3-a053-41ce-ac92-ba868643fc4b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.173714] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-502 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.173922] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-502" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.174076] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-502" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.174527] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-502" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.174809] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.174975] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.175109] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.175342] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.175501] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.175727] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 917.175853] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 917.175983] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 917.176106] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 917.176222] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 917.176329] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 917.176466] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 917.204114] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 917.204114] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 917.204217] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 917.204363] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-502" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.204843] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-41de0050-fea1-4ee6-80cc-d28d00a21001 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.204951] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-41de0050-fea1-4ee6-80cc-d28d00a21001" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.204991] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-41de0050-fea1-4ee6-80cc-d28d00a21001" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.205323] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-41de0050-fea1-4ee6-80cc-d28d00a21001" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.205468] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41de0050-fea1-4ee6-80cc-d28d00a21001',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.391865] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('da43fcb3-a053-41ce-ac92-ba868643fc4b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.707640] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.707849] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.707968] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.708326] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.708488] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.708668] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 41de0050-fea1-4ee6-80cc-d28d00a21001 not found, creating... [ 917.708952] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.709137] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.709253] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.709469] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.709608] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.709887] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.710144] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.710272] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.710480] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.710616] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.710815] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 41de0050-fea1-4ee6-80cc-d28d00a21001 is going to be created. [ 917.731751] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.731980] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.732117] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.732417] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.732650] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.732874] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-41de0050-fea1-4ee6-80cc-d28d00a21001" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.736721] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 in Status: SUCCESS [ 917.736953] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.893229] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('da43fcb3-a053-41ce-ac92-ba868643fc4b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.397737] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.397883] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.398016] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.398322] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.398442] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.398583] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da43fcb3-a053-41ce-ac92-ba868643fc4b is going to be updated. [ 918.426568] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.427290] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.427380] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.427596] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.427740] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.435656] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da43fcb3-a053-41ce-ac92-ba868643fc4b in Status: IN_PROGRESS for 2s [ 918.440243] env[68328]: INFO networking_nsxv3.common.synchronization [req-a2056e91-6a2c-4913-b0bc-253623f4c2c7 req-f7c84f79-1b26-4e3a-a85e-d986f2db161a service nova] Enqueued Resource ID: da43fcb3-a053-41ce-ac92-ba868643fc4b with Priority: HIGHEST for action security_group_rules [ 918.440243] env[68328]: INFO networking_nsxv3.common.synchronization [req-a2056e91-6a2c-4913-b0bc-253623f4c2c7 req-f7c84f79-1b26-4e3a-a85e-d986f2db161a service nova] Enqueued Resource ID: da43fcb3-a053-41ce-ac92-ba868643fc4b with Priority: HIGHEST for action security_group_members [ 918.440243] env[68328]: INFO networking_nsxv3.common.synchronization [req-a2056e91-6a2c-4913-b0bc-253623f4c2c7 req-f7c84f79-1b26-4e3a-a85e-d986f2db161a service nova] Enqueued Resource ID: 41de0050-fea1-4ee6-80cc-d28d00a21001 with Priority: HIGHEST for action port [ 918.440243] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da43fcb3-a053-41ce-ac92-ba868643fc4b with Priority: HIGHEST for action security_group_rules [ 918.440243] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da43fcb3-a053-41ce-ac92-ba868643fc4b with Priority: HIGHEST for action security_group_members [ 918.440243] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41de0050-fea1-4ee6-80cc-d28d00a21001 with Priority: HIGHEST for action port [ 918.440243] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da43fcb3-a053-41ce-ac92-ba868643fc4b taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.440243] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.440243] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.440243] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.440243] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da43fcb3-a053-41ce-ac92-ba868643fc4b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.441211] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-da43fcb3-a053-41ce-ac92-ba868643fc4b taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.441308] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.441494] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-41de0050-fea1-4ee6-80cc-d28d00a21001 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.441584] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41de0050-fea1-4ee6-80cc-d28d00a21001" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.441648] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41de0050-fea1-4ee6-80cc-d28d00a21001" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.441912] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41de0050-fea1-4ee6-80cc-d28d00a21001" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.442048] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41de0050-fea1-4ee6-80cc-d28d00a21001',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.487882] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 in Status: SUCCESS [ 918.488088] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 deletion is rescheduled due to dependency. [ 918.488204] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.488360] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.488813] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.488813] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.488944] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.488944] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.489124] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.489206] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.489302] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4bbd48a8-069c-43ef-b15c-47d19b8c7798',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.943621] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-da43fcb3-a053-41ce-ac92-ba868643fc4b taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.943908] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.946171] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 41de0050-fea1-4ee6-80cc-d28d00a21001 with status ACTIVE [ 918.947028] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.947028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.947028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.947028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.947028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.947294] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.947294] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.947294] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.947446] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.947542] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.947756] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.947860] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.947937] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.948125] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.948215] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.948306] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 41de0050-fea1-4ee6-80cc-d28d00a21001 is going to be updated. [ 918.969980] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.970563] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.970796] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.971097] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.971399] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.971652] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41de0050-fea1-4ee6-80cc-d28d00a21001" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.992303] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.992477] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.992549] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.992765] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.992858] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.993093] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.993210] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.993288] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.993447] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.993526] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.993616] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 is going to be updated. [ 919.026148] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.027011] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.027011] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.027011] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.027011] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.036412] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 in Status: IN_PROGRESS for 2s [ 920.445492] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da43fcb3-a053-41ce-ac92-ba868643fc4b in Status: SUCCESS [ 920.445748] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.445919] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.446151] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.446340] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.446456] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.446521] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.446665] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.446748] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.446844] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da43fcb3-a053-41ce-ac92-ba868643fc4b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.949503] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('da43fcb3-a053-41ce-ac92-ba868643fc4b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.046023] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 in Status: SUCCESS [ 921.046216] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 deletion is rescheduled due to dependency. [ 921.046382] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.452127] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('da43fcb3-a053-41ce-ac92-ba868643fc4b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.955806] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.955963] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.956047] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.956281] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.956427] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.956480] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da43fcb3-a053-41ce-ac92-ba868643fc4b is going to be updated. [ 922.010614] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.010614] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.010614] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.010836] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.010878] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.019502] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da43fcb3-a053-41ce-ac92-ba868643fc4b in Status: IN_PROGRESS for 2s [ 923.272752] env[68328]: INFO networking_nsxv3.common.synchronization [req-dc009e98-9dfd-434f-90a2-cebd5e206219 req-aba9c8a2-de78-405e-a5f6-a26964ecd353 tempest-ServersAdminTestJSON-340534059 tempest-ServersAdminTestJSON-340534059-project-member] Enqueued Resource ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed with Priority: HIGHEST for action security_group_members [ 923.273344] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed with Priority: HIGHEST for action security_group_members [ 923.273674] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.273795] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.273862] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.274069] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.274221] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.274320] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.274381] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.274528] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.274610] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.274705] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.777432] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.030388] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da43fcb3-a053-41ce-ac92-ba868643fc4b in Status: SUCCESS [ 924.030608] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.030848] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.031045] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.031241] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.031361] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.031413] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.031561] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.031643] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.031727] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.031834] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('da43fcb3-a053-41ce-ac92-ba868643fc4b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.279653] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.534676] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-da43fcb3-a053-41ce-ac92-ba868643fc4b taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.534856] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.534914] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.535216] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.535398] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.535515] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.535579] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.535746] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.535832] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.535936] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.536104] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-da43fcb3-a053-41ce-ac92-ba868643fc4b taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.536197] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.536256] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.536400] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.536537] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.536626] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.536684] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.537047] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.537047] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.537047] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.537047] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('da43fcb3-a053-41ce-ac92-ba868643fc4b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.781929] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.782106] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.782167] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.782385] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.782507] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.782614] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed is going to be updated. [ 924.810344] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.810511] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.810566] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.810844] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.811040] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.820682] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed in Status: IN_PROGRESS for 2s [ 925.039380] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for da43fcb3-a053-41ce-ac92-ba868643fc4b: rpc.has_security_group_logging(os_id): False [ 925.065559] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.065709] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.065783] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.065989] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.066118] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.066319] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.066430] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.066481] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.066689] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.066802] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.067097] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.067208] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.067269] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.067416] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.067504] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.067698] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.067789] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.067849] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.067984] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.068072] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.068170] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da43fcb3-a053-41ce-ac92-ba868643fc4b is going to be updated. [ 925.146369] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.146611] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.146611] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.146874] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.147069] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.177344] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da43fcb3-a053-41ce-ac92-ba868643fc4b in Status: IN_PROGRESS for 2s [ 925.453534] env[68328]: INFO networking_nsxv3.common.synchronization [req-122fc410-22d7-4279-bc2a-0ae3744b07f5 req-b901a53d-f954-42f2-9317-2d8c524e0f1e tempest-ImagesOneServerNegativeTestJSON-288072164 tempest-ImagesOneServerNegativeTestJSON-288072164-project-member] Enqueued Resource ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 with Priority: HIGHEST for action security_group_members [ 925.454531] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 with Priority: HIGHEST for action security_group_members [ 925.454874] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-55f209f1-d8fe-4d5e-a886-797753b1b3c1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.454998] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.455075] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.455312] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.455425] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.455562] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.455610] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.455746] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.455798] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.455871] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55f209f1-d8fe-4d5e-a886-797753b1b3c1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.731922] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-925 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.731922] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-925" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.731922] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-925" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.732170] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-925" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.732435] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.732600] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.732723] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.732937] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.733200] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.733425] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 925.733546] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 925.733660] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 925.733773] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 925.733939] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 925.733992] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 925.734140] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 925.752894] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 925.753474] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 925.753474] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 925.753474] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-925" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.753776] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-3a1dc9a4-161d-409e-92f5-0ac0f4e2e952 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.753950] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-3a1dc9a4-161d-409e-92f5-0ac0f4e2e952" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.754086] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-3a1dc9a4-161d-409e-92f5-0ac0f4e2e952" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.754426] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-3a1dc9a4-161d-409e-92f5-0ac0f4e2e952" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.754572] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a1dc9a4-161d-409e-92f5-0ac0f4e2e952',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.958194] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.958292] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.958292] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.958557] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.958694] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.958942] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.959116] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.959235] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.959440] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.959527] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.959643] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 is going to be deleted. [ 925.988947] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.988947] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.988947] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.988947] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.989186] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.989186] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.258397] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.258654] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.258826] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.259145] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.259309] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.259472] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 3a1dc9a4-161d-409e-92f5-0ac0f4e2e952 not found, creating... [ 926.259742] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.259904] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.260037] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.260274] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.260417] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.260721] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.261164] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.261164] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.261277] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.261417] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.261563] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 3a1dc9a4-161d-409e-92f5-0ac0f4e2e952 is going to be created. [ 926.282741] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.282960] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.283111] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.283443] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.283632] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.283861] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-3a1dc9a4-161d-409e-92f5-0ac0f4e2e952" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.829910] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed in Status: SUCCESS [ 926.830232] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.005301] env[68328]: INFO networking_nsxv3.common.synchronization [req-122fc410-22d7-4279-bc2a-0ae3744b07f5 req-5bc8bb7b-bdba-4c01-9bbb-099c35ef5f92 service nova] Enqueued Resource ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 with Priority: HIGHEST for action security_group_rules [ 927.005301] env[68328]: INFO networking_nsxv3.common.synchronization [req-122fc410-22d7-4279-bc2a-0ae3744b07f5 req-5bc8bb7b-bdba-4c01-9bbb-099c35ef5f92 service nova] Enqueued Resource ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 with Priority: HIGHEST for action security_group_members [ 927.005301] env[68328]: INFO networking_nsxv3.common.synchronization [req-122fc410-22d7-4279-bc2a-0ae3744b07f5 req-5bc8bb7b-bdba-4c01-9bbb-099c35ef5f92 service nova] Enqueued Resource ID: 3a1dc9a4-161d-409e-92f5-0ac0f4e2e952 with Priority: HIGHEST for action port [ 927.005301] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 with Priority: HIGHEST for action security_group_rules [ 927.005301] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 with Priority: HIGHEST for action security_group_members [ 927.005301] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a1dc9a4-161d-409e-92f5-0ac0f4e2e952 with Priority: HIGHEST for action port [ 927.007141] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55f209f1-d8fe-4d5e-a886-797753b1b3c1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.007457] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.007636] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.008069] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.008272] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55f209f1-d8fe-4d5e-a886-797753b1b3c1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.009327] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-55f209f1-d8fe-4d5e-a886-797753b1b3c1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.011020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.011020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.011020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.011020] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.011020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.011020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.011020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.011020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.011020] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55f209f1-d8fe-4d5e-a886-797753b1b3c1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.011840] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a1dc9a4-161d-409e-92f5-0ac0f4e2e952 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.012082] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a1dc9a4-161d-409e-92f5-0ac0f4e2e952" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.012383] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a1dc9a4-161d-409e-92f5-0ac0f4e2e952" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.012637] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a1dc9a4-161d-409e-92f5-0ac0f4e2e952" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.012867] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a1dc9a4-161d-409e-92f5-0ac0f4e2e952',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.190722] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da43fcb3-a053-41ce-ac92-ba868643fc4b in Status: SUCCESS [ 927.191193] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.512881] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55f209f1-d8fe-4d5e-a886-797753b1b3c1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.513944] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-55f209f1-d8fe-4d5e-a886-797753b1b3c1 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.514083] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.514439] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3a1dc9a4-161d-409e-92f5-0ac0f4e2e952 with status ACTIVE [ 927.514610] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.514720] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.514779] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.515141] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.515221] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.515389] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.515476] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.515538] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.515685] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.515756] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.515935] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.516029] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.516085] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.516224] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.516297] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.516379] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3a1dc9a4-161d-409e-92f5-0ac0f4e2e952 is going to be updated. [ 927.535767] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.535877] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.535948] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.536218] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.536383] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.536540] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a1dc9a4-161d-409e-92f5-0ac0f4e2e952" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.015010] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55f209f1-d8fe-4d5e-a886-797753b1b3c1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.133627] env[68328]: INFO networking_nsxv3.common.synchronization [req-d2962338-7e5d-48ce-8521-f28cc5559e2b req-c0307c8e-19e0-4aca-8741-bd210f66ef11 tempest-ServerAddressesTestJSON-79297064 tempest-ServerAddressesTestJSON-79297064-project-member] Enqueued Resource ID: 64f74f98-269e-44e8-8235-fe4f7a472b01 with Priority: HIGHEST for action security_group_members [ 928.135781] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64f74f98-269e-44e8-8235-fe4f7a472b01 with Priority: HIGHEST for action security_group_members [ 928.135781] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-64f74f98-269e-44e8-8235-fe4f7a472b01 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.135781] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64f74f98-269e-44e8-8235-fe4f7a472b01" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.135781] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64f74f98-269e-44e8-8235-fe4f7a472b01" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.135781] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64f74f98-269e-44e8-8235-fe4f7a472b01" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.135781] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.135781] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.135781] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.135781] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.138620] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.138620] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64f74f98-269e-44e8-8235-fe4f7a472b01',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.516149] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-589 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.516355] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-589" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.516485] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-589" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.516959] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-589" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.517316] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.517452] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.517581] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.517835] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.517990] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.518223] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 928.518344] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 928.518474] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 928.518588] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 928.518711] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 928.518840] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 928.518981] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 928.520471] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.520603] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.520670] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.520900] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.521029] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.521085] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 is going to be created. [ 928.543287] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 928.543509] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 928.543672] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 928.543854] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-589" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.544206] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-ecf64182-cee3-45a6-bc83-62de2cdd43cc taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.544408] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-ecf64182-cee3-45a6-bc83-62de2cdd43cc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.544531] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-ecf64182-cee3-45a6-bc83-62de2cdd43cc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.544867] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-ecf64182-cee3-45a6-bc83-62de2cdd43cc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.545555] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ecf64182-cee3-45a6-bc83-62de2cdd43cc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.547233] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.547364] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.547432] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.547637] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.547790] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.561251] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 in Status: UNINITIALIZED for 2s [ 928.641684] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.641943] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.642060] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.642294] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.642387] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.642593] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.642695] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.642752] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.642930] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.643017] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.643105] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64f74f98-269e-44e8-8235-fe4f7a472b01 already deleted. [ 928.643184] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64f74f98-269e-44e8-8235-fe4f7a472b01" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.050428] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.050790] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.050790] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.051149] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.051309] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.051472] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port ecf64182-cee3-45a6-bc83-62de2cdd43cc not found, creating... [ 929.051740] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.051929] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.052073] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.052303] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.052446] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.052739] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.052900] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.053246] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.053246] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.053400] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.053515] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: ecf64182-cee3-45a6-bc83-62de2cdd43cc is going to be created. [ 929.072253] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.072476] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.072585] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.072859] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.073112] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.073353] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-ecf64182-cee3-45a6-bc83-62de2cdd43cc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.064973] env[68328]: INFO networking_nsxv3.common.synchronization [req-d2962338-7e5d-48ce-8521-f28cc5559e2b req-e0acd4b1-86ae-4a69-953a-88b1e3434aa7 service nova] Enqueued Resource ID: 64f74f98-269e-44e8-8235-fe4f7a472b01 with Priority: HIGHEST for action security_group_rules [ 930.065292] env[68328]: INFO networking_nsxv3.common.synchronization [req-d2962338-7e5d-48ce-8521-f28cc5559e2b req-e0acd4b1-86ae-4a69-953a-88b1e3434aa7 service nova] Enqueued Resource ID: 64f74f98-269e-44e8-8235-fe4f7a472b01 with Priority: HIGHEST for action security_group_members [ 930.065292] env[68328]: INFO networking_nsxv3.common.synchronization [req-d2962338-7e5d-48ce-8521-f28cc5559e2b req-e0acd4b1-86ae-4a69-953a-88b1e3434aa7 service nova] Enqueued Resource ID: ecf64182-cee3-45a6-bc83-62de2cdd43cc with Priority: HIGHEST for action port [ 930.065647] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64f74f98-269e-44e8-8235-fe4f7a472b01 with Priority: HIGHEST for action security_group_rules [ 930.065975] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64f74f98-269e-44e8-8235-fe4f7a472b01 with Priority: HIGHEST for action security_group_members [ 930.065975] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecf64182-cee3-45a6-bc83-62de2cdd43cc with Priority: HIGHEST for action port [ 930.066234] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64f74f98-269e-44e8-8235-fe4f7a472b01 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.066363] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64f74f98-269e-44e8-8235-fe4f7a472b01" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.066429] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64f74f98-269e-44e8-8235-fe4f7a472b01" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.066682] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64f74f98-269e-44e8-8235-fe4f7a472b01" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.066768] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64f74f98-269e-44e8-8235-fe4f7a472b01',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.068223] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-64f74f98-269e-44e8-8235-fe4f7a472b01 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.068223] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64f74f98-269e-44e8-8235-fe4f7a472b01" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.068349] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64f74f98-269e-44e8-8235-fe4f7a472b01" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.068541] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64f74f98-269e-44e8-8235-fe4f7a472b01" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.068541] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.068675] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.068675] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.068849] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.068982] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.069098] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64f74f98-269e-44e8-8235-fe4f7a472b01',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.070799] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-ecf64182-cee3-45a6-bc83-62de2cdd43cc taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.070960] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ecf64182-cee3-45a6-bc83-62de2cdd43cc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.071042] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ecf64182-cee3-45a6-bc83-62de2cdd43cc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.071206] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ecf64182-cee3-45a6-bc83-62de2cdd43cc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.071280] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ecf64182-cee3-45a6-bc83-62de2cdd43cc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.573117] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 in Status: SUCCESS [ 930.573117] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.573117] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.573117] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.573117] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.573117] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.573117] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.573117] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.573117] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.573117] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.573117] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('55f209f1-d8fe-4d5e-a886-797753b1b3c1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.573918] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('64f74f98-269e-44e8-8235-fe4f7a472b01',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.574843] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-64f74f98-269e-44e8-8235-fe4f7a472b01 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.575107] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64f74f98-269e-44e8-8235-fe4f7a472b01" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.575352] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ecf64182-cee3-45a6-bc83-62de2cdd43cc with status ACTIVE [ 930.575593] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.575797] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.575930] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.576165] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.576407] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.576652] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.576855] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.577073] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.577395] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.577598] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.577848] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.578052] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.578188] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.578399] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.578548] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.578724] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ecf64182-cee3-45a6-bc83-62de2cdd43cc is going to be updated. [ 930.595081] env[68328]: INFO networking_nsxv3.common.synchronization [req-5b16d220-d3cd-4d84-8359-7db9263da1a8 req-cc60ce3e-24e7-40d1-a01b-7adfc3440262 tempest-ServerRescueNegativeTestJSON-1315865897 tempest-ServerRescueNegativeTestJSON-1315865897-project-member] Enqueued Resource ID: fef607f8-3758-4e8a-87f1-a5984690df6e with Priority: HIGHEST for action security_group_members [ 930.596442] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fef607f8-3758-4e8a-87f1-a5984690df6e with Priority: HIGHEST for action security_group_members [ 930.596864] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-fef607f8-3758-4e8a-87f1-a5984690df6e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.597117] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.597287] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.597664] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.597919] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.598137] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.598274] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.598500] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.598663] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.598874] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fef607f8-3758-4e8a-87f1-a5984690df6e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.600778] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.601043] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.601264] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.601630] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.601857] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.604344] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ecf64182-cee3-45a6-bc83-62de2cdd43cc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.925085] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-682 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.925085] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-682" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.925085] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-682" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.925364] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-682" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.925625] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.925779] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.925904] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.927300] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.927471] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.929095] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 930.929095] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 930.929095] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 930.929095] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 930.929095] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 930.929095] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 930.929095] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 930.946724] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 930.947296] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 930.948024] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 930.948024] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-682" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.948266] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-7f76e79f-34ff-410d-9a1e-f0a24273e5e1 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.948510] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-7f76e79f-34ff-410d-9a1e-f0a24273e5e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.948686] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-7f76e79f-34ff-410d-9a1e-f0a24273e5e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.951540] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-7f76e79f-34ff-410d-9a1e-f0a24273e5e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.951540] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f76e79f-34ff-410d-9a1e-f0a24273e5e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.081185] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-55f209f1-d8fe-4d5e-a886-797753b1b3c1 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.081797] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.081797] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.081797] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.081797] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.082054] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.082054] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.082141] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.082185] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.082304] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.082402] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-55f209f1-d8fe-4d5e-a886-797753b1b3c1 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.082502] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.082554] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.082679] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.082810] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.082899] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.082959] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.083144] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.083210] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.083788] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.083788] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('55f209f1-d8fe-4d5e-a886-797753b1b3c1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.084699] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('64f74f98-269e-44e8-8235-fe4f7a472b01',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.105648] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.105739] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.105788] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.108111] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.108111] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.108111] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.108111] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.108111] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.108111] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.108111] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.108111] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fef607f8-3758-4e8a-87f1-a5984690df6e already deleted. [ 931.108111] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.453022] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.453022] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.453191] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.453459] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.453672] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.453898] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 7f76e79f-34ff-410d-9a1e-f0a24273e5e1 not found, creating... [ 931.454551] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.454551] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.454847] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.455210] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.455289] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.455757] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.455901] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.456095] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.456393] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.456594] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.456808] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 7f76e79f-34ff-410d-9a1e-f0a24273e5e1 is going to be created. [ 931.476401] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.476699] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.476835] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.477272] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.477534] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.477809] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-7f76e79f-34ff-410d-9a1e-f0a24273e5e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.586714] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 55f209f1-d8fe-4d5e-a886-797753b1b3c1: rpc.has_security_group_logging(os_id): False [ 931.589811] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.590044] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.590044] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.590379] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.590473] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.590506] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64f74f98-269e-44e8-8235-fe4f7a472b01 is going to be created. [ 931.605495] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.605708] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.605748] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.605990] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.606099] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.606324] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.606423] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.606590] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.606659] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.606705] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.606924] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.607016] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.607047] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.607185] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.607261] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.607479] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.607561] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.607621] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.607758] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.607829] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.607914] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 is going to be created. [ 931.620056] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.620231] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.620265] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.620452] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.620605] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.629885] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64f74f98-269e-44e8-8235-fe4f7a472b01 in Status: UNINITIALIZED for 2s [ 931.676336] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.676336] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.676336] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.676336] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.676336] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.688848] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 in Status: IN_PROGRESS for 2s [ 932.221456] env[68328]: INFO networking_nsxv3.common.synchronization [req-5b16d220-d3cd-4d84-8359-7db9263da1a8 req-f0e21424-1d31-4caf-8f52-2eb55b8fe98d service nova] Enqueued Resource ID: fef607f8-3758-4e8a-87f1-a5984690df6e with Priority: HIGHEST for action security_group_rules [ 932.221456] env[68328]: INFO networking_nsxv3.common.synchronization [req-5b16d220-d3cd-4d84-8359-7db9263da1a8 req-f0e21424-1d31-4caf-8f52-2eb55b8fe98d service nova] Enqueued Resource ID: fef607f8-3758-4e8a-87f1-a5984690df6e with Priority: HIGHEST for action security_group_members [ 932.221456] env[68328]: INFO networking_nsxv3.common.synchronization [req-5b16d220-d3cd-4d84-8359-7db9263da1a8 req-f0e21424-1d31-4caf-8f52-2eb55b8fe98d service nova] Enqueued Resource ID: 7f76e79f-34ff-410d-9a1e-f0a24273e5e1 with Priority: HIGHEST for action port [ 932.221456] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fef607f8-3758-4e8a-87f1-a5984690df6e with Priority: HIGHEST for action security_group_rules [ 932.221456] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fef607f8-3758-4e8a-87f1-a5984690df6e with Priority: HIGHEST for action security_group_members [ 932.221456] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f76e79f-34ff-410d-9a1e-f0a24273e5e1 with Priority: HIGHEST for action port [ 932.222978] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fef607f8-3758-4e8a-87f1-a5984690df6e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.223218] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.224895] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.225282] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.225734] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fef607f8-3758-4e8a-87f1-a5984690df6e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.227788] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-fef607f8-3758-4e8a-87f1-a5984690df6e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.227788] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.227788] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.227788] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.227788] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.227788] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.227788] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.227788] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.229285] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.229285] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fef607f8-3758-4e8a-87f1-a5984690df6e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.230894] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f76e79f-34ff-410d-9a1e-f0a24273e5e1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.230894] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f76e79f-34ff-410d-9a1e-f0a24273e5e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.230894] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f76e79f-34ff-410d-9a1e-f0a24273e5e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.230894] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f76e79f-34ff-410d-9a1e-f0a24273e5e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.230894] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f76e79f-34ff-410d-9a1e-f0a24273e5e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.733051] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-fef607f8-3758-4e8a-87f1-a5984690df6e taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.733051] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.733185] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fef607f8-3758-4e8a-87f1-a5984690df6e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.734063] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7f76e79f-34ff-410d-9a1e-f0a24273e5e1 with status ACTIVE [ 932.734257] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.734372] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.734439] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.734638] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.734728] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.734905] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.735260] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.735260] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.735260] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.735448] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.735515] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.735628] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.735658] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.735790] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.735862] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.735946] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7f76e79f-34ff-410d-9a1e-f0a24273e5e1 is going to be updated. [ 932.760105] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.760249] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.760321] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.760537] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.760671] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.760831] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f76e79f-34ff-410d-9a1e-f0a24273e5e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.030079] env[68328]: INFO networking_nsxv3.common.synchronization [req-92c63e1c-5699-481c-8fb0-70cf01536b9a req-bd8c08a8-cc50-4d7b-9ab1-043bf40acdd4 tempest-FloatingIPsAssociationTestJSON-1038327510 tempest-FloatingIPsAssociationTestJSON-1038327510-project-member] Enqueued Resource ID: da43fcb3-a053-41ce-ac92-ba868643fc4b with Priority: HIGHEST for action security_group_members [ 933.030079] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da43fcb3-a053-41ce-ac92-ba868643fc4b with Priority: HIGHEST for action security_group_members [ 933.030079] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-da43fcb3-a053-41ce-ac92-ba868643fc4b taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.030079] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.030079] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.030079] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.030079] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.030079] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.030079] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.030079] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.030079] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.030079] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da43fcb3-a053-41ce-ac92-ba868643fc4b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.239652] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fef607f8-3758-4e8a-87f1-a5984690df6e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.341170] env[68328]: INFO networking_nsxv3.common.synchronization [req-152eee30-6985-4ac0-991c-2d31525e7b5d req-b6133be3-f8aa-4c46-82d7-d99373c74475 tempest-ServerRescueNegativeTestJSON-1315865897 tempest-ServerRescueNegativeTestJSON-1315865897-project-member] Enqueued Resource ID: fef607f8-3758-4e8a-87f1-a5984690df6e with Priority: HIGHEST for action security_group_members [ 933.341759] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fef607f8-3758-4e8a-87f1-a5984690df6e with Priority: HIGHEST for action security_group_members [ 933.342212] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-fef607f8-3758-4e8a-87f1-a5984690df6e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.342276] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.534138] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('da43fcb3-a053-41ce-ac92-ba868643fc4b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.639331] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64f74f98-269e-44e8-8235-fe4f7a472b01 in Status: SUCCESS [ 933.639707] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64f74f98-269e-44e8-8235-fe4f7a472b01" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.639841] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64f74f98-269e-44e8-8235-fe4f7a472b01" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.640061] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64f74f98-269e-44e8-8235-fe4f7a472b01" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.640250] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.640361] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.640416] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.640828] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.640828] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.640828] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64f74f98-269e-44e8-8235-fe4f7a472b01" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.640828] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('64f74f98-269e-44e8-8235-fe4f7a472b01',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.702185] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 in Status: SUCCESS [ 933.703026] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.712866] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-682 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.713184] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-682" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.713333] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-682" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.713786] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-682" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.713914] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.714343] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.714343] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.714537] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.714722] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.715777] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 933.715777] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 933.715777] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 933.715777] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 933.715777] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 933.715777] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 933.715777] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 933.734176] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 933.734327] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 933.735630] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 933.735630] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-682" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.735630] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-ecf52576-cbab-479c-adb0-f0444179a69d taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.735630] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-ecf52576-cbab-479c-adb0-f0444179a69d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.735630] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-ecf52576-cbab-479c-adb0-f0444179a69d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.735630] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-ecf52576-cbab-479c-adb0-f0444179a69d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.735928] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ecf52576-cbab-479c-adb0-f0444179a69d',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.743505] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.743995] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.744647] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.744647] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.744647] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.744647] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fef607f8-3758-4e8a-87f1-a5984690df6e is going to be created. [ 933.767399] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.767562] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.767634] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.767896] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.767994] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.781080] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fef607f8-3758-4e8a-87f1-a5984690df6e in Status: UNINITIALIZED for 2s [ 934.041332] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('da43fcb3-a053-41ce-ac92-ba868643fc4b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.145765] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-64f74f98-269e-44e8-8235-fe4f7a472b01 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.145980] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64f74f98-269e-44e8-8235-fe4f7a472b01" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.146071] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64f74f98-269e-44e8-8235-fe4f7a472b01" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.146349] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64f74f98-269e-44e8-8235-fe4f7a472b01" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.146607] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.146755] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.146852] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.147097] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.147223] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.147354] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64f74f98-269e-44e8-8235-fe4f7a472b01" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.147564] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-64f74f98-269e-44e8-8235-fe4f7a472b01 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.147695] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64f74f98-269e-44e8-8235-fe4f7a472b01" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.147796] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64f74f98-269e-44e8-8235-fe4f7a472b01" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.148036] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64f74f98-269e-44e8-8235-fe4f7a472b01" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.148215] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.148351] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.148449] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.148655] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.148897] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.149064] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64f74f98-269e-44e8-8235-fe4f7a472b01" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.149213] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('64f74f98-269e-44e8-8235-fe4f7a472b01',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.237862] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.238211] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.238369] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.238663] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.239155] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.239430] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port ecf52576-cbab-479c-adb0-f0444179a69d not found, creating... [ 934.239830] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.240133] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.240324] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.240679] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.241797] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.242189] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.242370] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.242495] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.242739] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.242888] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.243050] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: ecf52576-cbab-479c-adb0-f0444179a69d is going to be created. [ 934.262530] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.262797] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.262877] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.263165] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.263399] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.263630] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-ecf52576-cbab-479c-adb0-f0444179a69d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.543632] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.544372] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.544372] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.544372] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.544372] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.544620] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da43fcb3-a053-41ce-ac92-ba868643fc4b is going to be updated. [ 934.571225] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.571225] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.571225] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.571439] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.571439] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.579584] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da43fcb3-a053-41ce-ac92-ba868643fc4b in Status: IN_PROGRESS for 2s [ 934.652743] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 64f74f98-269e-44e8-8235-fe4f7a472b01: rpc.has_security_group_logging(os_id): False [ 934.679730] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.680071] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.680283] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.680643] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.680903] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.681670] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.681981] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.682107] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.682397] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.682529] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.682843] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.682995] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.683079] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.683229] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.683306] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.683490] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.683582] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.683644] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.683782] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.683855] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.683941] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64f74f98-269e-44e8-8235-fe4f7a472b01 is going to be created. [ 934.759451] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.759650] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.759650] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.759858] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.760069] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.770014] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64f74f98-269e-44e8-8235-fe4f7a472b01 in Status: IN_PROGRESS for 2s [ 935.037945] env[68328]: INFO networking_nsxv3.common.synchronization [req-152eee30-6985-4ac0-991c-2d31525e7b5d req-a734fc10-dbc7-46ef-a1a0-8921a043d072 service nova] Enqueued Resource ID: fef607f8-3758-4e8a-87f1-a5984690df6e with Priority: HIGHEST for action security_group_rules [ 935.038257] env[68328]: INFO networking_nsxv3.common.synchronization [req-152eee30-6985-4ac0-991c-2d31525e7b5d req-a734fc10-dbc7-46ef-a1a0-8921a043d072 service nova] Enqueued Resource ID: fef607f8-3758-4e8a-87f1-a5984690df6e with Priority: HIGHEST for action security_group_members [ 935.038408] env[68328]: INFO networking_nsxv3.common.synchronization [req-152eee30-6985-4ac0-991c-2d31525e7b5d req-a734fc10-dbc7-46ef-a1a0-8921a043d072 service nova] Enqueued Resource ID: ecf52576-cbab-479c-adb0-f0444179a69d with Priority: HIGHEST for action port [ 935.040518] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fef607f8-3758-4e8a-87f1-a5984690df6e with Priority: HIGHEST for action security_group_rules [ 935.040518] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fef607f8-3758-4e8a-87f1-a5984690df6e with Priority: HIGHEST for action security_group_members [ 935.040518] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecf52576-cbab-479c-adb0-f0444179a69d with Priority: HIGHEST for action port [ 935.040518] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fef607f8-3758-4e8a-87f1-a5984690df6e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.040518] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.040518] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-fef607f8-3758-4e8a-87f1-a5984690df6e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.040518] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.040518] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-ecf52576-cbab-479c-adb0-f0444179a69d taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.040518] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ecf52576-cbab-479c-adb0-f0444179a69d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.040518] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ecf52576-cbab-479c-adb0-f0444179a69d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.041186] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ecf52576-cbab-479c-adb0-f0444179a69d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.041186] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ecf52576-cbab-479c-adb0-f0444179a69d',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.550020] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ecf52576-cbab-479c-adb0-f0444179a69d with status ACTIVE [ 935.550020] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.550020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.550020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.550020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.550020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.550020] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.550020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.550020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.550020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.550020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.550020] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.550020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.550020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.550020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.550020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.550020] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ecf52576-cbab-479c-adb0-f0444179a69d is going to be updated. [ 935.571519] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.571674] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.571721] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.571974] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.572131] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.572292] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ecf52576-cbab-479c-adb0-f0444179a69d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.791028] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fef607f8-3758-4e8a-87f1-a5984690df6e in Status: SUCCESS [ 935.791260] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.791446] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.791666] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.791859] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.791971] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.792046] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.792195] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.792275] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.792358] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.792457] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fef607f8-3758-4e8a-87f1-a5984690df6e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.793652] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.793652] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.793652] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.793774] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.793851] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.793970] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.794078] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.794294] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fef607f8-3758-4e8a-87f1-a5984690df6e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.296049] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-fef607f8-3758-4e8a-87f1-a5984690df6e taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.296407] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.296407] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fef607f8-3758-4e8a-87f1-a5984690df6e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.592910] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da43fcb3-a053-41ce-ac92-ba868643fc4b in Status: SUCCESS [ 936.593203] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.782751] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64f74f98-269e-44e8-8235-fe4f7a472b01 in Status: SUCCESS [ 936.782751] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64f74f98-269e-44e8-8235-fe4f7a472b01" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.800026] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fef607f8-3758-4e8a-87f1-a5984690df6e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.302677] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.302777] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.302851] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.303325] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.303325] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.303325] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fef607f8-3758-4e8a-87f1-a5984690df6e is going to be updated. [ 937.330203] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.331025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.331025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.331025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.331025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.339509] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fef607f8-3758-4e8a-87f1-a5984690df6e in Status: IN_PROGRESS for 2s [ 939.350789] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fef607f8-3758-4e8a-87f1-a5984690df6e in Status: SUCCESS [ 939.351160] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.351210] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.351502] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.351634] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.351755] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.351820] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.352023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.352092] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.352196] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fef607f8-3758-4e8a-87f1-a5984690df6e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.490152] env[68328]: INFO networking_nsxv3.common.synchronization [req-f19b090c-d528-45e0-9aaa-8e1ba481592f req-ab0d5634-62bb-4c06-9a75-0a01355c6991 tempest-ServerAddressesTestJSON-79297064 tempest-ServerAddressesTestJSON-79297064-project-member] Enqueued Resource ID: 64f74f98-269e-44e8-8235-fe4f7a472b01 with Priority: HIGHEST for action security_group_members [ 939.490722] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64f74f98-269e-44e8-8235-fe4f7a472b01 with Priority: HIGHEST for action security_group_members [ 939.491692] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-64f74f98-269e-44e8-8235-fe4f7a472b01 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.491692] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64f74f98-269e-44e8-8235-fe4f7a472b01" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.491692] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64f74f98-269e-44e8-8235-fe4f7a472b01" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.491692] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64f74f98-269e-44e8-8235-fe4f7a472b01" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.491914] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.491914] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.491914] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.492116] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.492152] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.492523] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64f74f98-269e-44e8-8235-fe4f7a472b01',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.636340] env[68328]: INFO networking_nsxv3.common.synchronization [None req-41039c22-e6ce-41f0-996b-2d10f9b9a15e tempest-ServerActionsTestJSON-719988657 tempest-ServerActionsTestJSON-719988657-project-member] Enqueued Resource ID: 57513254-a6e5-4b1e-87b8-b529d35f4b6b with Priority: HIGHEST for action security_group_rules [ 939.636877] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57513254-a6e5-4b1e-87b8-b529d35f4b6b with Priority: HIGHEST for action security_group_rules [ 939.638961] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57513254-a6e5-4b1e-87b8-b529d35f4b6b taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.638961] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57513254-a6e5-4b1e-87b8-b529d35f4b6b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.638961] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57513254-a6e5-4b1e-87b8-b529d35f4b6b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.638961] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57513254-a6e5-4b1e-87b8-b529d35f4b6b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.638961] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57513254-a6e5-4b1e-87b8-b529d35f4b6b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.798032] env[68328]: INFO networking_nsxv3.common.synchronization [None req-1df58ea5-1caa-471c-9298-e3e598ae24bb tempest-ServerActionsTestJSON-719988657 tempest-ServerActionsTestJSON-719988657-project-member] Enqueued Resource ID: 57513254-a6e5-4b1e-87b8-b529d35f4b6b with Priority: HIGHEST for action security_group_rules [ 939.798032] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57513254-a6e5-4b1e-87b8-b529d35f4b6b with Priority: HIGHEST for action security_group_rules [ 939.798032] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57513254-a6e5-4b1e-87b8-b529d35f4b6b taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.798032] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57513254-a6e5-4b1e-87b8-b529d35f4b6b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.854923] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fef607f8-3758-4e8a-87f1-a5984690df6e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.995336] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.995540] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.995608] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.995784] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.995878] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.996091] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.996187] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.996315] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.996486] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.996567] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.996654] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64f74f98-269e-44e8-8235-fe4f7a472b01 is going to be updated. [ 940.025919] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.026121] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.026221] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.026466] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.026638] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.035255] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64f74f98-269e-44e8-8235-fe4f7a472b01 in Status: IN_PROGRESS for 2s [ 940.162986] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.162986] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.162986] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.162986] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.162986] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.162986] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57513254-a6e5-4b1e-87b8-b529d35f4b6b already deleted. [ 940.162986] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57513254-a6e5-4b1e-87b8-b529d35f4b6b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.162986] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57513254-a6e5-4b1e-87b8-b529d35f4b6b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.163292] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57513254-a6e5-4b1e-87b8-b529d35f4b6b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.163810] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57513254-a6e5-4b1e-87b8-b529d35f4b6b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.357544] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fef607f8-3758-4e8a-87f1-a5984690df6e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.688264] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.688423] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.688496] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.688711] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.688807] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.688923] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57513254-a6e5-4b1e-87b8-b529d35f4b6b already deleted. [ 940.688994] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57513254-a6e5-4b1e-87b8-b529d35f4b6b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.860286] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.860574] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.860670] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.860879] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.861049] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.861156] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fef607f8-3758-4e8a-87f1-a5984690df6e is going to be updated. [ 940.889846] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.890060] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.890060] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.890256] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.890390] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.898118] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fef607f8-3758-4e8a-87f1-a5984690df6e in Status: IN_PROGRESS for 2s [ 942.046376] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64f74f98-269e-44e8-8235-fe4f7a472b01 in Status: SUCCESS [ 942.046675] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64f74f98-269e-44e8-8235-fe4f7a472b01 deletion is rescheduled due to dependency. [ 942.046717] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64f74f98-269e-44e8-8235-fe4f7a472b01" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.907850] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fef607f8-3758-4e8a-87f1-a5984690df6e in Status: SUCCESS [ 942.908148] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.908508] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.908725] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.908914] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.909064] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.909127] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.909277] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.909359] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.909444] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.909636] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-fef607f8-3758-4e8a-87f1-a5984690df6e taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.909741] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.909915] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.909915] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.910071] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.910189] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.910258] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.910415] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.910479] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.910562] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.910667] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fef607f8-3758-4e8a-87f1-a5984690df6e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.414041] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fef607f8-3758-4e8a-87f1-a5984690df6e: rpc.has_security_group_logging(os_id): False [ 943.431367] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.431576] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.431576] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.431784] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.431874] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.432110] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.432211] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.432272] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.432426] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.432503] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.432685] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.432775] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.432834] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.432974] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.433061] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.433258] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.433345] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.433404] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.433539] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.433610] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.433693] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fef607f8-3758-4e8a-87f1-a5984690df6e is going to be created. [ 943.489025] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.489025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.489025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.489025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.489025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.499445] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fef607f8-3758-4e8a-87f1-a5984690df6e in Status: IN_PROGRESS for 2s [ 944.795915] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 944.796194] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 945.511560] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fef607f8-3758-4e8a-87f1-a5984690df6e in Status: SUCCESS [ 945.511783] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.511973] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.512249] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.512339] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fef607f8-3758-4e8a-87f1-a5984690df6e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.831489] env[68328]: INFO networking_nsxv3.common.synchronization [req-bdc5d2ed-ed36-4fe2-bc13-3e4f77666920 req-f39dfd97-c7a7-408c-8ca7-64c76ccb2f66 tempest-ListServerFiltersTestJSON-1110536152 tempest-ListServerFiltersTestJSON-1110536152-project-member] Enqueued Resource ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f with Priority: HIGHEST for action security_group_members [ 945.832077] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f with Priority: HIGHEST for action security_group_members [ 945.832427] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.832549] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.832630] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.832881] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.833606] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.833606] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.833606] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.833883] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.833972] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.834211] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5812c2b-73e7-421d-b4bb-29c4ef848f3f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.015298] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-fef607f8-3758-4e8a-87f1-a5984690df6e taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.015472] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.015535] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.015764] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.016220] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.016438] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.016503] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.016685] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.016776] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.016867] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.016961] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fef607f8-3758-4e8a-87f1-a5984690df6e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.281834] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-259 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.282071] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-259" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.282252] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-259" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.282533] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-259" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.282853] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.282958] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.285435] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.285718] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.285885] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.286133] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 946.286259] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 946.286374] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 946.286486] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 946.286630] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 946.286705] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 946.286852] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 946.306933] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 946.307161] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 946.307816] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 946.307816] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-259" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.308038] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-7aaba325-0e3b-4c80-bbdb-a8edcc33508a taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.308218] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-7aaba325-0e3b-4c80-bbdb-a8edcc33508a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.308345] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-7aaba325-0e3b-4c80-bbdb-a8edcc33508a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.309128] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-7aaba325-0e3b-4c80-bbdb-a8edcc33508a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.309423] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7aaba325-0e3b-4c80-bbdb-a8edcc33508a',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.336944] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.336944] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.336944] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.336944] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.337339] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.337339] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.337458] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.337458] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.338423] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.338423] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.338423] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f already deleted. [ 946.338423] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.519733] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-fef607f8-3758-4e8a-87f1-a5984690df6e taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.519970] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.520095] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.521249] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.521501] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.521736] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.521794] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.521985] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.522164] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.522282] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.522490] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-fef607f8-3758-4e8a-87f1-a5984690df6e taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.522675] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.522741] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.522936] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.523141] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.523288] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.523395] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.523588] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.523711] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.523843] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.523989] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fef607f8-3758-4e8a-87f1-a5984690df6e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.812289] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.812494] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.812622] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.812913] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.813082] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.813246] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 7aaba325-0e3b-4c80-bbdb-a8edcc33508a not found, creating... [ 946.813511] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.813734] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.813898] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.814500] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.814500] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.814668] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.814835] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.814957] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.815188] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.815434] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.815489] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 7aaba325-0e3b-4c80-bbdb-a8edcc33508a is going to be created. [ 946.833557] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.833891] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.833891] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.834147] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.834393] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.834619] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-7aaba325-0e3b-4c80-bbdb-a8edcc33508a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.026431] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fef607f8-3758-4e8a-87f1-a5984690df6e: rpc.has_security_group_logging(os_id): False [ 947.044241] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.044399] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.044399] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.044611] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.044709] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.044911] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.045021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.045086] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.045237] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.045315] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.045498] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.045593] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.045655] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.045792] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.045866] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.046067] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.046162] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.046223] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.046393] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.046458] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.046548] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fef607f8-3758-4e8a-87f1-a5984690df6e is going to be updated. [ 947.110189] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.110337] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.110419] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.110619] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.110762] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.121284] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fef607f8-3758-4e8a-87f1-a5984690df6e in Status: IN_PROGRESS for 2s [ 947.600030] env[68328]: INFO networking_nsxv3.common.synchronization [req-a2f7cfb9-478c-4d1f-9a4c-6cd2806db6c5 req-98d4d6f1-5760-4073-86a5-fb68457a8c39 tempest-ImagesOneServerNegativeTestJSON-288072164 tempest-ImagesOneServerNegativeTestJSON-288072164-project-member] Enqueued Resource ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 with Priority: HIGHEST for action security_group_members [ 947.600653] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 with Priority: HIGHEST for action security_group_members [ 947.601012] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-55f209f1-d8fe-4d5e-a886-797753b1b3c1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.602132] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.602217] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.602432] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.602593] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.602695] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.602752] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.602912] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.602997] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.603108] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55f209f1-d8fe-4d5e-a886-797753b1b3c1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.663806] env[68328]: INFO networking_nsxv3.common.synchronization [req-bdc5d2ed-ed36-4fe2-bc13-3e4f77666920 req-14760fff-17d8-48a9-a585-a73fa787f93f service nova] Enqueued Resource ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f with Priority: HIGHEST for action security_group_rules [ 947.664010] env[68328]: INFO networking_nsxv3.common.synchronization [req-bdc5d2ed-ed36-4fe2-bc13-3e4f77666920 req-14760fff-17d8-48a9-a585-a73fa787f93f service nova] Enqueued Resource ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f with Priority: HIGHEST for action security_group_members [ 947.664209] env[68328]: INFO networking_nsxv3.common.synchronization [req-bdc5d2ed-ed36-4fe2-bc13-3e4f77666920 req-14760fff-17d8-48a9-a585-a73fa787f93f service nova] Enqueued Resource ID: 7aaba325-0e3b-4c80-bbdb-a8edcc33508a with Priority: HIGHEST for action port [ 947.664722] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f with Priority: HIGHEST for action security_group_rules [ 947.664860] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f with Priority: HIGHEST for action security_group_members [ 947.664980] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7aaba325-0e3b-4c80-bbdb-a8edcc33508a with Priority: HIGHEST for action port [ 947.666246] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b5812c2b-73e7-421d-b4bb-29c4ef848f3f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.666381] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.666450] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.666705] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.666792] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b5812c2b-73e7-421d-b4bb-29c4ef848f3f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.667645] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.667763] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.667827] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.667999] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.668168] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.668263] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.668324] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.668466] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.668549] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.668642] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5812c2b-73e7-421d-b4bb-29c4ef848f3f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.669393] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-7aaba325-0e3b-4c80-bbdb-a8edcc33508a taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.669518] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7aaba325-0e3b-4c80-bbdb-a8edcc33508a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.669587] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7aaba325-0e3b-4c80-bbdb-a8edcc33508a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.669735] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7aaba325-0e3b-4c80-bbdb-a8edcc33508a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.669809] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7aaba325-0e3b-4c80-bbdb-a8edcc33508a',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.106344] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.106344] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.106344] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.106344] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.106344] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.106835] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.106835] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.106835] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.106835] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.106835] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.106987] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 is going to be updated. [ 948.137159] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.137159] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.137159] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.137159] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.137159] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.145288] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 in Status: IN_PROGRESS for 2s [ 948.173432] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.173432] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.173432] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b5812c2b-73e7-421d-b4bb-29c4ef848f3f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.175029] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7aaba325-0e3b-4c80-bbdb-a8edcc33508a with status ACTIVE [ 948.175029] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.175029] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.175029] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.175029] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.175029] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.175029] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.175279] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.175279] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.175279] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.175362] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.176024] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.176024] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.176024] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.176024] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.176024] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.176024] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7aaba325-0e3b-4c80-bbdb-a8edcc33508a is going to be updated. [ 948.204209] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.204407] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.204481] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.204759] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.204962] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.205186] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7aaba325-0e3b-4c80-bbdb-a8edcc33508a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.677995] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b5812c2b-73e7-421d-b4bb-29c4ef848f3f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.134239] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fef607f8-3758-4e8a-87f1-a5984690df6e in Status: SUCCESS [ 949.134572] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.180106] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.180303] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.180396] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.180669] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.180877] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.180877] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f is going to be created. [ 949.209601] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.209778] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.209896] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.210242] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.210510] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.220394] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f in Status: UNINITIALIZED for 2s [ 950.162023] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 in Status: SUCCESS [ 950.162316] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 deletion is rescheduled due to dependency. [ 950.162359] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.236022] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f in Status: SUCCESS [ 951.236319] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.236429] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.236646] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.236845] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.237936] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.237936] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.237936] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.237936] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.237936] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.237936] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b5812c2b-73e7-421d-b4bb-29c4ef848f3f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.415839] env[68328]: INFO networking_nsxv3.common.synchronization [req-a3c8105c-657b-4781-8fb0-b38dd80a16c1 req-4f6a4a9f-30da-4d52-b1cd-431c2eb40da4 tempest-ListServerFiltersTestJSON-1110536152 tempest-ListServerFiltersTestJSON-1110536152-project-member] Enqueued Resource ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f with Priority: HIGHEST for action security_group_members [ 951.416417] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f with Priority: HIGHEST for action security_group_members [ 951.416705] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.416854] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.416927] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.417598] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.417722] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.417834] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.417910] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.418048] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.418117] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.418213] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5812c2b-73e7-421d-b4bb-29c4ef848f3f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.710932] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-259 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.711244] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-259" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.711394] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-259" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.711695] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-259" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.712032] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.712237] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.712400] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.712667] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.712828] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.713090] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 951.713220] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 951.713337] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 951.713450] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 951.713586] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 951.713709] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 951.713865] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 951.731417] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 951.731596] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 951.731740] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 951.731925] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-259" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.732306] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-5f51c038-c3e4-4593-8686-d45f6091f8f6 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.732510] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-5f51c038-c3e4-4593-8686-d45f6091f8f6" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.732645] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-5f51c038-c3e4-4593-8686-d45f6091f8f6" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.733016] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-5f51c038-c3e4-4593-8686-d45f6091f8f6" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.733185] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f51c038-c3e4-4593-8686-d45f6091f8f6',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.739192] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.739357] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.921391] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b5812c2b-73e7-421d-b4bb-29c4ef848f3f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.236265] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.236586] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.236626] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.236906] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.237121] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.237294] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 5f51c038-c3e4-4593-8686-d45f6091f8f6 not found, creating... [ 952.237560] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.237722] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.237845] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.238106] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.238253] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.238542] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.238702] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.238822] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.239077] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.239210] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.239443] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 5f51c038-c3e4-4593-8686-d45f6091f8f6 is going to be created. [ 952.257299] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.257508] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.257644] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.257892] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.258141] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.258482] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-5f51c038-c3e4-4593-8686-d45f6091f8f6" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.425056] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b5812c2b-73e7-421d-b4bb-29c4ef848f3f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.926500] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.926668] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.926739] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.926987] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.927077] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.927201] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f is going to be updated. [ 952.952783] env[68328]: INFO networking_nsxv3.common.synchronization [req-a3c8105c-657b-4781-8fb0-b38dd80a16c1 req-92df8538-ca1b-4640-a434-380cacd3facf service nova] Enqueued Resource ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f with Priority: HIGHEST for action security_group_rules [ 952.952914] env[68328]: INFO networking_nsxv3.common.synchronization [req-a3c8105c-657b-4781-8fb0-b38dd80a16c1 req-92df8538-ca1b-4640-a434-380cacd3facf service nova] Enqueued Resource ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f with Priority: HIGHEST for action security_group_members [ 952.953075] env[68328]: INFO networking_nsxv3.common.synchronization [req-a3c8105c-657b-4781-8fb0-b38dd80a16c1 req-92df8538-ca1b-4640-a434-380cacd3facf service nova] Enqueued Resource ID: 5f51c038-c3e4-4593-8686-d45f6091f8f6 with Priority: HIGHEST for action port [ 952.954169] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.954295] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.954363] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.954563] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.954700] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.955759] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f with Priority: HIGHEST for action security_group_rules [ 952.955893] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f with Priority: HIGHEST for action security_group_members [ 952.955989] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f51c038-c3e4-4593-8686-d45f6091f8f6 with Priority: HIGHEST for action port [ 952.956509] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b5812c2b-73e7-421d-b4bb-29c4ef848f3f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.956606] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.956801] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.956882] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.957072] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f51c038-c3e4-4593-8686-d45f6091f8f6 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.957170] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f51c038-c3e4-4593-8686-d45f6091f8f6" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.957223] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f51c038-c3e4-4593-8686-d45f6091f8f6" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.957388] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f51c038-c3e4-4593-8686-d45f6091f8f6" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.957464] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f51c038-c3e4-4593-8686-d45f6091f8f6',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.967201] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f in Status: IN_PROGRESS for 2s [ 953.459382] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5f51c038-c3e4-4593-8686-d45f6091f8f6 with status ACTIVE [ 953.459701] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.459766] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.459803] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.460022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.460137] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.460814] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.460957] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.461053] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.461244] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.461324] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.461532] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.461634] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.461696] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.461837] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.462034] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.462034] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5f51c038-c3e4-4593-8686-d45f6091f8f6 is going to be updated. [ 953.482132] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.482132] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.482132] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.482132] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.482132] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.482132] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f51c038-c3e4-4593-8686-d45f6091f8f6" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.976467] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f in Status: SUCCESS [ 954.976866] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.976866] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.977109] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.977425] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.977523] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.977585] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.977754] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.977834] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.977920] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.978094] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.978175] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.978233] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.978368] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.978499] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.978602] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.978672] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.978810] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.978883] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.978981] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.979086] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b5812c2b-73e7-421d-b4bb-29c4ef848f3f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.980053] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.980168] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.980250] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.980350] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.980412] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.980548] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.980623] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.980708] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5812c2b-73e7-421d-b4bb-29c4ef848f3f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.482843] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b5812c2b-73e7-421d-b4bb-29c4ef848f3f: rpc.has_security_group_logging(os_id): False [ 955.484300] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b5812c2b-73e7-421d-b4bb-29c4ef848f3f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.500935] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.501245] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.501353] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.501605] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.501703] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.501935] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.502615] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.502615] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.502615] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.502615] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.502788] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.502788] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.502933] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.502933] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.503016] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.503224] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.503315] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.503373] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.503513] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.503588] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.503671] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f is going to be created. [ 955.559175] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.559175] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.559175] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.559175] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.559175] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.569510] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f in Status: IN_PROGRESS for 2s [ 955.986777] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b5812c2b-73e7-421d-b4bb-29c4ef848f3f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.490450] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.490859] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.490999] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.491258] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.491355] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.491456] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f is going to be updated. [ 956.521177] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.521403] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.521403] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.521587] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.521727] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.529534] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f in Status: IN_PROGRESS for 2s [ 956.894652] env[68328]: INFO networking_nsxv3.common.synchronization [req-083f8cf8-813e-4100-8c84-bdf7f2db5d02 req-6ce1e69e-60a9-40bb-a661-bc15b92e54bb tempest-ListServerFiltersTestJSON-1110536152 tempest-ListServerFiltersTestJSON-1110536152-project-member] Enqueued Resource ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f with Priority: HIGHEST for action security_group_members [ 956.897134] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f with Priority: HIGHEST for action security_group_members [ 956.897134] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.897134] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.582336] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f in Status: SUCCESS [ 957.582670] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.582722] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.582932] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.583026] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b5812c2b-73e7-421d-b4bb-29c4ef848f3f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.673170] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-259 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.673383] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-259" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.673512] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-259" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.673785] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-259" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.674078] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.674252] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.674375] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.674594] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.674742] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.674955] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 957.675088] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 957.675204] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 957.675317] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 957.675431] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 957.675540] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 957.675678] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 957.693257] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 957.693457] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 957.693588] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 957.693774] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-259" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.694158] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-c0ec09f3-ca85-4433-8b56-e7bfdf150271 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.694278] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-c0ec09f3-ca85-4433-8b56-e7bfdf150271" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.694400] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-c0ec09f3-ca85-4433-8b56-e7bfdf150271" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.694732] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-c0ec09f3-ca85-4433-8b56-e7bfdf150271" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.694877] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0ec09f3-ca85-4433-8b56-e7bfdf150271',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.088774] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.088955] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.199578] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.199740] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.199796] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.200090] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.200291] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.201173] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port c0ec09f3-ca85-4433-8b56-e7bfdf150271 not found, creating... [ 958.201173] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.201173] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.201429] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.201521] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.201650] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.202229] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.202431] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.202560] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.202788] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.202976] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.203163] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: c0ec09f3-ca85-4433-8b56-e7bfdf150271 is going to be created. [ 958.231843] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.232161] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.232335] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.232629] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.232866] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.233119] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-c0ec09f3-ca85-4433-8b56-e7bfdf150271" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.538619] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f in Status: SUCCESS [ 958.538882] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.539102] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.539337] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.539535] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.539663] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.539729] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.539879] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.539960] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.540073] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5812c2b-73e7-421d-b4bb-29c4ef848f3f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.960066] env[68328]: INFO networking_nsxv3.common.synchronization [req-083f8cf8-813e-4100-8c84-bdf7f2db5d02 req-a88c0998-7483-498c-979b-7263ff51f051 service nova] Enqueued Resource ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f with Priority: HIGHEST for action security_group_rules [ 958.960296] env[68328]: INFO networking_nsxv3.common.synchronization [req-083f8cf8-813e-4100-8c84-bdf7f2db5d02 req-a88c0998-7483-498c-979b-7263ff51f051 service nova] Enqueued Resource ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f with Priority: HIGHEST for action security_group_members [ 958.960414] env[68328]: INFO networking_nsxv3.common.synchronization [req-083f8cf8-813e-4100-8c84-bdf7f2db5d02 req-a88c0998-7483-498c-979b-7263ff51f051 service nova] Enqueued Resource ID: c0ec09f3-ca85-4433-8b56-e7bfdf150271 with Priority: HIGHEST for action port [ 958.960611] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f with Priority: HIGHEST for action security_group_rules [ 958.960767] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f with Priority: HIGHEST for action security_group_members [ 958.960817] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0ec09f3-ca85-4433-8b56-e7bfdf150271 with Priority: HIGHEST for action port [ 958.961451] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b5812c2b-73e7-421d-b4bb-29c4ef848f3f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.961523] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.961716] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.961796] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.964020] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-c0ec09f3-ca85-4433-8b56-e7bfdf150271 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.964020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c0ec09f3-ca85-4433-8b56-e7bfdf150271" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.964020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c0ec09f3-ca85-4433-8b56-e7bfdf150271" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.964020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c0ec09f3-ca85-4433-8b56-e7bfdf150271" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.964020] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0ec09f3-ca85-4433-8b56-e7bfdf150271',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.042657] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b5812c2b-73e7-421d-b4bb-29c4ef848f3f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.240851] env[68328]: INFO networking_nsxv3.common.synchronization [req-0e57d464-9d87-4991-8e05-ec8c1a32b60e req-f952aa3c-9201-4d71-a376-b2dabf3d6b02 tempest-ServerRescueTestJSONUnderV235-188857036 tempest-ServerRescueTestJSONUnderV235-188857036-project-member] Enqueued Resource ID: 28940b1a-276d-41ed-a135-91ce1b6e2b2c with Priority: HIGHEST for action security_group_members [ 959.241407] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28940b1a-276d-41ed-a135-91ce1b6e2b2c with Priority: HIGHEST for action security_group_members [ 959.241713] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-28940b1a-276d-41ed-a135-91ce1b6e2b2c taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.241834] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.241901] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.242215] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.242375] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.242476] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.242539] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.242692] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.242776] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.242871] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28940b1a-276d-41ed-a135-91ce1b6e2b2c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.467217] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c0ec09f3-ca85-4433-8b56-e7bfdf150271 with status ACTIVE [ 959.467329] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.471021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.471021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.471021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.471021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.471021] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.471021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.471021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.471021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.471021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.471021] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.471021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.471021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.471021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.471021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.471021] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c0ec09f3-ca85-4433-8b56-e7bfdf150271 is going to be updated. [ 959.489017] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.489167] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.489233] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.489425] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.489549] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.489705] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c0ec09f3-ca85-4433-8b56-e7bfdf150271" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.527475] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-366 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.527722] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-366" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.527880] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-366" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.528248] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-366" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.528546] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.528720] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.528862] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.529982] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.529982] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.529982] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 959.529982] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 959.529982] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 959.530236] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 959.530236] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 959.530340] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 959.530474] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 959.544035] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b5812c2b-73e7-421d-b4bb-29c4ef848f3f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.547641] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 959.548145] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 959.548145] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 959.548145] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-366" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.548484] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-c81326a7-7335-4ca9-8c56-3e0880115c43 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.548625] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-c81326a7-7335-4ca9-8c56-3e0880115c43" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.548751] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-c81326a7-7335-4ca9-8c56-3e0880115c43" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.549185] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-c81326a7-7335-4ca9-8c56-3e0880115c43" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.549288] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c81326a7-7335-4ca9-8c56-3e0880115c43',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.746455] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.746745] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.746856] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.747224] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.747387] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.747737] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.747916] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.748050] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.748303] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.748452] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.748620] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28940b1a-276d-41ed-a135-91ce1b6e2b2c already deleted. [ 959.748716] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.047024] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.047367] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.047367] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.047574] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.047670] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.047774] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f is going to be updated. [ 960.051748] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.051951] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.052116] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.052439] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.052601] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.052758] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port c81326a7-7335-4ca9-8c56-3e0880115c43 not found, creating... [ 960.053028] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.053193] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.053335] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.053744] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.053923] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.054245] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.054437] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.054565] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.054785] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.054925] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.055129] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: c81326a7-7335-4ca9-8c56-3e0880115c43 is going to be created. [ 960.068709] env[68328]: INFO networking_nsxv3.common.synchronization [req-3a1182e8-5ae9-4ecc-ad67-0a7f108e3a5e req-33695416-9a5b-49d0-9e26-5ab40b837ca9 tempest-MigrationsAdminTest-1924704487 tempest-MigrationsAdminTest-1924704487-project-member] Enqueued Resource ID: ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 with Priority: HIGHEST for action security_group_members [ 960.069266] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 with Priority: HIGHEST for action security_group_members [ 960.069567] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.069683] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.069745] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.069938] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.070224] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.071086] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.071086] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.071086] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.071212] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.071747] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ccbebeb4-60d7-4344-b96e-b9dfdeae14b1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.073490] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.073670] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.073797] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.074032] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.074279] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.074711] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-c81326a7-7335-4ca9-8c56-3e0880115c43" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.076714] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.077069] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.077069] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.077069] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.077254] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.085652] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f in Status: IN_PROGRESS for 2s [ 960.578076] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ccbebeb4-60d7-4344-b96e-b9dfdeae14b1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.778238] env[68328]: INFO networking_nsxv3.common.synchronization [req-0e57d464-9d87-4991-8e05-ec8c1a32b60e req-015e4aef-9f1d-4974-a3c2-36c7e4166e98 service nova] Enqueued Resource ID: 28940b1a-276d-41ed-a135-91ce1b6e2b2c with Priority: HIGHEST for action security_group_rules [ 960.778238] env[68328]: INFO networking_nsxv3.common.synchronization [req-0e57d464-9d87-4991-8e05-ec8c1a32b60e req-015e4aef-9f1d-4974-a3c2-36c7e4166e98 service nova] Enqueued Resource ID: 28940b1a-276d-41ed-a135-91ce1b6e2b2c with Priority: HIGHEST for action security_group_members [ 960.778316] env[68328]: INFO networking_nsxv3.common.synchronization [req-0e57d464-9d87-4991-8e05-ec8c1a32b60e req-015e4aef-9f1d-4974-a3c2-36c7e4166e98 service nova] Enqueued Resource ID: c81326a7-7335-4ca9-8c56-3e0880115c43 with Priority: HIGHEST for action port [ 960.778822] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28940b1a-276d-41ed-a135-91ce1b6e2b2c with Priority: HIGHEST for action security_group_rules [ 960.778974] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28940b1a-276d-41ed-a135-91ce1b6e2b2c with Priority: HIGHEST for action security_group_members [ 960.780431] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c81326a7-7335-4ca9-8c56-3e0880115c43 with Priority: HIGHEST for action port [ 960.780829] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28940b1a-276d-41ed-a135-91ce1b6e2b2c taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.780957] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.781066] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.781414] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.781514] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28940b1a-276d-41ed-a135-91ce1b6e2b2c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.783512] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-28940b1a-276d-41ed-a135-91ce1b6e2b2c taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.783777] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.783872] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.784103] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.784362] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.784516] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.784599] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.784810] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.784933] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.785102] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28940b1a-276d-41ed-a135-91ce1b6e2b2c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.786897] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-c81326a7-7335-4ca9-8c56-3e0880115c43 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.787064] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c81326a7-7335-4ca9-8c56-3e0880115c43" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.787175] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c81326a7-7335-4ca9-8c56-3e0880115c43" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.787406] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c81326a7-7335-4ca9-8c56-3e0880115c43" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.787532] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c81326a7-7335-4ca9-8c56-3e0880115c43',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.080210] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ccbebeb4-60d7-4344-b96e-b9dfdeae14b1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.284529] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-28940b1a-276d-41ed-a135-91ce1b6e2b2c taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.284834] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.287373] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('28940b1a-276d-41ed-a135-91ce1b6e2b2c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.289327] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c81326a7-7335-4ca9-8c56-3e0880115c43 with status ACTIVE [ 961.289450] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.289727] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.290367] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.290367] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.290487] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.292372] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.292372] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.292372] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.292372] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.292372] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.292372] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.292372] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.292372] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.293163] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.293163] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.293163] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c81326a7-7335-4ca9-8c56-3e0880115c43 is going to be updated. [ 961.331906] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.332159] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.332217] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.332470] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.332634] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.332857] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c81326a7-7335-4ca9-8c56-3e0880115c43" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.583568] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.583724] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.583793] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.583999] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.584111] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.584205] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 is going to be updated. [ 961.609285] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.609455] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.609489] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.609699] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.609859] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.623910] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 in Status: IN_PROGRESS for 2s [ 961.790171] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('28940b1a-276d-41ed-a135-91ce1b6e2b2c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.947342] env[68328]: INFO networking_nsxv3.common.synchronization [req-fb2e1757-5767-46e5-b173-0f528441dfc8 req-d8cb7782-a711-4dc5-8d00-6d985cc0f325 tempest-AttachInterfacesTestJSON-966841523 tempest-AttachInterfacesTestJSON-966841523-project-member] Enqueued Resource ID: 0c5088e7-0ed1-4112-b902-8fd593a8b34e with Priority: HIGHEST for action security_group_members [ 961.947850] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c5088e7-0ed1-4112-b902-8fd593a8b34e with Priority: HIGHEST for action security_group_members [ 961.948581] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c5088e7-0ed1-4112-b902-8fd593a8b34e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.948581] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c5088e7-0ed1-4112-b902-8fd593a8b34e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.948581] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c5088e7-0ed1-4112-b902-8fd593a8b34e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.948779] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c5088e7-0ed1-4112-b902-8fd593a8b34e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.948910] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.948997] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.949855] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.950211] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.950211] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.950211] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c5088e7-0ed1-4112-b902-8fd593a8b34e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.095684] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f in Status: SUCCESS [ 962.095684] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.096164] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.096968] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.096968] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.096968] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.096968] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.096968] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.097682] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.097826] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.097904] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b5812c2b-73e7-421d-b4bb-29c4ef848f3f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.102543] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.102543] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.102543] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.102543] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.102543] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.102543] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.102543] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.102992] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5812c2b-73e7-421d-b4bb-29c4ef848f3f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.293128] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.293340] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.293425] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.293685] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.293775] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.293897] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28940b1a-276d-41ed-a135-91ce1b6e2b2c is going to be created. [ 962.315873] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.315873] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.315873] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.316200] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.316200] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.324085] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28940b1a-276d-41ed-a135-91ce1b6e2b2c in Status: UNINITIALIZED for 2s [ 962.453458] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.453631] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.453718] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.453931] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.454044] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.454296] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.454399] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.454436] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.454602] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.454687] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.454840] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c5088e7-0ed1-4112-b902-8fd593a8b34e already deleted. [ 962.454876] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c5088e7-0ed1-4112-b902-8fd593a8b34e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.575736] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-615 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.575963] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-615" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.576107] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-615" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.576382] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-615" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.576645] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.576806] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.576929] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.577668] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.577839] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.578072] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 962.578196] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 962.578313] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 962.578427] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 962.578544] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 962.578655] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 962.578798] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 962.602653] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.602860] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.604392] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 962.604563] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 962.604726] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 962.604921] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-615" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.605268] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-5cf6f89c-f2d7-47d2-b077-addb550230e0 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.605446] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-5cf6f89c-f2d7-47d2-b077-addb550230e0" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.605570] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-5cf6f89c-f2d7-47d2-b077-addb550230e0" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.605984] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-5cf6f89c-f2d7-47d2-b077-addb550230e0" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.606092] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cf6f89c-f2d7-47d2-b077-addb550230e0',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.611840] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b5812c2b-73e7-421d-b4bb-29c4ef848f3f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.807026] env[68328]: INFO networking_nsxv3.common.synchronization [req-ffbc81d5-ef8d-4f8d-823c-70ccb74b5d2a req-cd86e03b-96df-4ac3-b7de-b6f1f3c87793 tempest-ServersAdminTestJSON-340534059 tempest-ServersAdminTestJSON-340534059-project-member] Enqueued Resource ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed with Priority: HIGHEST for action security_group_members [ 962.807026] env[68328]: INFO networking_nsxv3.common.synchronization [req-993eb19e-401d-4931-92d9-261526f49e27 req-defb3042-012c-4168-936d-0657d9657ccb tempest-VolumesAdminNegativeTest-207194333 tempest-VolumesAdminNegativeTest-207194333-project-member] Enqueued Resource ID: b3fc1540-17fb-42c4-99d2-880ae35db079 with Priority: HIGHEST for action security_group_members [ 962.807475] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed with Priority: HIGHEST for action security_group_members [ 962.807614] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3fc1540-17fb-42c4-99d2-880ae35db079 with Priority: HIGHEST for action security_group_members [ 962.807896] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.807999] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.808081] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.808302] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.808464] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.808559] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.808639] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.808797] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.808877] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.808966] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.810621] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3fc1540-17fb-42c4-99d2-880ae35db079 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.810795] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3fc1540-17fb-42c4-99d2-880ae35db079" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.810877] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3fc1540-17fb-42c4-99d2-880ae35db079" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.811425] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3fc1540-17fb-42c4-99d2-880ae35db079" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.811425] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.811425] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.811425] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.811613] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.811673] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.811766] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b3fc1540-17fb-42c4-99d2-880ae35db079',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.108520] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.108820] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.108909] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.109244] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.109423] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.109591] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 5cf6f89c-f2d7-47d2-b077-addb550230e0 not found, creating... [ 963.109873] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.110053] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.110178] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.110446] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.110672] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.110890] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.111229] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.111381] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.111611] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.111756] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.111978] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 5cf6f89c-f2d7-47d2-b077-addb550230e0 is going to be created. [ 963.115320] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b5812c2b-73e7-421d-b4bb-29c4ef848f3f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.131738] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.131963] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.132100] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.132380] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.132629] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.132866] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-5cf6f89c-f2d7-47d2-b077-addb550230e0" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.311706] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.311896] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.311974] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.313110] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.313259] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.313624] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.313747] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.313818] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.314017] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.314157] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.314275] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed is going to be updated. [ 963.315502] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.315613] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.315667] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.315836] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.335254] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.335540] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.335670] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.335741] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.335938] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.336039] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.336135] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b3fc1540-17fb-42c4-99d2-880ae35db079 is going to be updated. [ 963.342946] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.343139] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.343199] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.343378] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.343552] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.350506] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed in Status: IN_PROGRESS for 2s [ 963.363588] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.363737] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.363886] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.364062] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.364151] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.374567] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3fc1540-17fb-42c4-99d2-880ae35db079 in Status: IN_PROGRESS for 2s [ 963.620686] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.620686] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.620686] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.620686] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.620686] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.620686] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f is going to be updated. [ 963.636435] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 in Status: SUCCESS [ 963.636435] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.646451] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.648298] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.648434] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.648640] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.649088] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.656583] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f in Status: IN_PROGRESS for 2s [ 963.850692] env[68328]: INFO networking_nsxv3.common.synchronization [req-fb2e1757-5767-46e5-b173-0f528441dfc8 req-d0f6cd53-a76f-4659-9a15-5125b37db240 service nova] Enqueued Resource ID: 0c5088e7-0ed1-4112-b902-8fd593a8b34e with Priority: HIGHEST for action security_group_rules [ 963.850692] env[68328]: INFO networking_nsxv3.common.synchronization [req-fb2e1757-5767-46e5-b173-0f528441dfc8 req-d0f6cd53-a76f-4659-9a15-5125b37db240 service nova] Enqueued Resource ID: 0c5088e7-0ed1-4112-b902-8fd593a8b34e with Priority: HIGHEST for action security_group_members [ 963.850692] env[68328]: INFO networking_nsxv3.common.synchronization [req-fb2e1757-5767-46e5-b173-0f528441dfc8 req-d0f6cd53-a76f-4659-9a15-5125b37db240 service nova] Enqueued Resource ID: 5cf6f89c-f2d7-47d2-b077-addb550230e0 with Priority: HIGHEST for action port [ 963.850692] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c5088e7-0ed1-4112-b902-8fd593a8b34e with Priority: HIGHEST for action security_group_rules [ 963.850692] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c5088e7-0ed1-4112-b902-8fd593a8b34e with Priority: HIGHEST for action security_group_members [ 963.850692] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5cf6f89c-f2d7-47d2-b077-addb550230e0 with Priority: HIGHEST for action port [ 963.850692] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c5088e7-0ed1-4112-b902-8fd593a8b34e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.850692] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c5088e7-0ed1-4112-b902-8fd593a8b34e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.850692] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c5088e7-0ed1-4112-b902-8fd593a8b34e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.850990] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c5088e7-0ed1-4112-b902-8fd593a8b34e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.850990] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c5088e7-0ed1-4112-b902-8fd593a8b34e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.851750] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c5088e7-0ed1-4112-b902-8fd593a8b34e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.851826] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c5088e7-0ed1-4112-b902-8fd593a8b34e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.851897] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c5088e7-0ed1-4112-b902-8fd593a8b34e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.852239] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c5088e7-0ed1-4112-b902-8fd593a8b34e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.852297] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.852407] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.852468] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.852631] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.852691] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.852782] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c5088e7-0ed1-4112-b902-8fd593a8b34e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.853507] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-5cf6f89c-f2d7-47d2-b077-addb550230e0 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.853610] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5cf6f89c-f2d7-47d2-b077-addb550230e0" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.853677] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5cf6f89c-f2d7-47d2-b077-addb550230e0" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.853826] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5cf6f89c-f2d7-47d2-b077-addb550230e0" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.854018] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cf6f89c-f2d7-47d2-b077-addb550230e0',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.335376] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28940b1a-276d-41ed-a135-91ce1b6e2b2c in Status: SUCCESS [ 964.335376] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.335376] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.335726] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.335726] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.335928] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.335928] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.336152] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.336152] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.336903] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.336903] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('28940b1a-276d-41ed-a135-91ce1b6e2b2c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.353726] env[68328]: INFO networking_nsxv3.common.synchronization [req-1663f60a-e0a3-4c94-a078-f72d1cba063a req-70ab2ff0-de11-4db8-85fc-ee6d140fb812 tempest-FloatingIPsAssociationTestJSON-1038327510 tempest-FloatingIPsAssociationTestJSON-1038327510-project-member] Enqueued Resource ID: da43fcb3-a053-41ce-ac92-ba868643fc4b with Priority: HIGHEST for action security_group_members [ 964.354685] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da43fcb3-a053-41ce-ac92-ba868643fc4b with Priority: HIGHEST for action security_group_members [ 964.354927] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c5088e7-0ed1-4112-b902-8fd593a8b34e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.355731] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c5088e7-0ed1-4112-b902-8fd593a8b34e taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.355836] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c5088e7-0ed1-4112-b902-8fd593a8b34e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.356050] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-da43fcb3-a053-41ce-ac92-ba868643fc4b taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.356157] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.356224] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.356412] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.356553] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.356649] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.356712] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.356845] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.356924] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.357014] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da43fcb3-a053-41ce-ac92-ba868643fc4b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.357994] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5cf6f89c-f2d7-47d2-b077-addb550230e0 with status ACTIVE [ 964.358219] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.358373] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.358475] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.358699] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.358834] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.359071] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.359182] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.359248] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.359415] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.359474] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.359654] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.359746] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.359828] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.360011] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.360101] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.360222] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5cf6f89c-f2d7-47d2-b077-addb550230e0 is going to be updated. [ 964.378930] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.379950] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.380058] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.380255] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.380399] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.380557] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5cf6f89c-f2d7-47d2-b077-addb550230e0" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.421024] env[68328]: INFO networking_nsxv3.common.synchronization [req-bb15fbc4-fc1d-4e66-a576-c5f7294330ae req-852db31a-1a2b-4075-be4c-b2787b47d0b0 tempest-ServerActionsTestOtherA-501294167 tempest-ServerActionsTestOtherA-501294167-project-member] Enqueued Resource ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 with Priority: HIGHEST for action security_group_members [ 964.421024] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 with Priority: HIGHEST for action security_group_members [ 964.422230] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-35b651ef-47c8-4ff2-b472-9849f375b8c9 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.422230] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.422230] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.422230] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.422230] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.422230] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.422230] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.422532] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.422532] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.422532] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35b651ef-47c8-4ff2-b472-9849f375b8c9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.719851] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-113 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.720054] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-113" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.720198] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-113" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.720583] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-113" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.720856] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.721072] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.721232] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.721457] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.721598] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.721808] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 964.721918] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 964.722041] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 964.722152] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 964.722260] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 964.722364] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 964.722496] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 964.741412] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 964.741412] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 964.741412] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 964.741412] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-113" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.741412] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-c54ea75f-f5fc-4b6e-bdf3-05617dfc3e23 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.741412] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-c54ea75f-f5fc-4b6e-bdf3-05617dfc3e23" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.742040] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-c54ea75f-f5fc-4b6e-bdf3-05617dfc3e23" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.742040] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-c54ea75f-f5fc-4b6e-bdf3-05617dfc3e23" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.742040] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c54ea75f-f5fc-4b6e-bdf3-05617dfc3e23',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.838665] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-28940b1a-276d-41ed-a135-91ce1b6e2b2c taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.838862] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.838962] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.839233] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.839442] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.839571] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.840130] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.840130] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.840130] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.840130] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.840130] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-28940b1a-276d-41ed-a135-91ce1b6e2b2c taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.840323] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.840323] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.840386] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.840576] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.840640] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.840640] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.840858] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.840858] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.840947] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.840998] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('28940b1a-276d-41ed-a135-91ce1b6e2b2c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.858278] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c5088e7-0ed1-4112-b902-8fd593a8b34e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.863235] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.863372] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.863437] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.863823] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.864020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.864241] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.864354] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.864413] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.864672] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.864672] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.864899] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da43fcb3-a053-41ce-ac92-ba868643fc4b is going to be updated. [ 964.903281] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.903485] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.903618] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.903883] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.904069] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.924550] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.924550] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.924550] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.924777] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.924819] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.925489] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.925489] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.925489] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.925489] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.925489] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.925489] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 already deleted. [ 964.925758] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.936401] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da43fcb3-a053-41ce-ac92-ba868643fc4b in Status: IN_PROGRESS for 2s [ 965.245011] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.245283] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.245420] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.245714] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.245883] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.246338] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port c54ea75f-f5fc-4b6e-bdf3-05617dfc3e23 not found, creating... [ 965.246559] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.246661] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.246771] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.247122] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.247284] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.247601] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.247811] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.247943] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.248230] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.248383] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.248534] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: c54ea75f-f5fc-4b6e-bdf3-05617dfc3e23 is going to be created. [ 965.269366] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.269594] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.269726] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.270106] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.270347] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.270627] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-c54ea75f-f5fc-4b6e-bdf3-05617dfc3e23" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.345411] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 28940b1a-276d-41ed-a135-91ce1b6e2b2c: rpc.has_security_group_logging(os_id): False [ 965.360539] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.360649] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.360758] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.360930] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.360988] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.361127] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c5088e7-0ed1-4112-b902-8fd593a8b34e is going to be created. [ 965.364284] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed in Status: SUCCESS [ 965.364467] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed deletion is rescheduled due to dependency. [ 965.364553] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.370151] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.370255] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.370355] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.370475] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.370584] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.370757] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.370852] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.370909] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.371070] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.371157] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.371353] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.371449] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.371510] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.371650] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.371720] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.371892] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.371985] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.372051] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.372193] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.372283] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.372367] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28940b1a-276d-41ed-a135-91ce1b6e2b2c is going to be created. [ 965.382944] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3fc1540-17fb-42c4-99d2-880ae35db079 in Status: SUCCESS [ 965.383456] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b3fc1540-17fb-42c4-99d2-880ae35db079 deletion is rescheduled due to dependency. [ 965.383456] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3fc1540-17fb-42c4-99d2-880ae35db079" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.395056] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.395056] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.395056] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.395302] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.395413] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.413659] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c5088e7-0ed1-4112-b902-8fd593a8b34e in Status: UNINITIALIZED for 2s [ 965.453354] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.454663] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.454663] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.454663] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.454663] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.466219] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28940b1a-276d-41ed-a135-91ce1b6e2b2c in Status: IN_PROGRESS for 2s [ 965.666226] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f in Status: SUCCESS [ 965.666450] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.666636] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.666907] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.667294] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.667408] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.667529] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.667700] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.667737] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.667813] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.667996] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.668148] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.668253] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.668438] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.668608] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.668746] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.668841] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.669357] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.669357] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.669357] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.669357] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b5812c2b-73e7-421d-b4bb-29c4ef848f3f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.978749] env[68328]: INFO networking_nsxv3.common.synchronization [req-bb15fbc4-fc1d-4e66-a576-c5f7294330ae req-c064f5f1-bd44-4543-9cc4-ce8cf38b49b5 service nova] Enqueued Resource ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 with Priority: HIGHEST for action security_group_rules [ 965.978927] env[68328]: INFO networking_nsxv3.common.synchronization [req-bb15fbc4-fc1d-4e66-a576-c5f7294330ae req-c064f5f1-bd44-4543-9cc4-ce8cf38b49b5 service nova] Enqueued Resource ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 with Priority: HIGHEST for action security_group_members [ 965.979092] env[68328]: INFO networking_nsxv3.common.synchronization [req-bb15fbc4-fc1d-4e66-a576-c5f7294330ae req-c064f5f1-bd44-4543-9cc4-ce8cf38b49b5 service nova] Enqueued Resource ID: c54ea75f-f5fc-4b6e-bdf3-05617dfc3e23 with Priority: HIGHEST for action port [ 965.979654] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 with Priority: HIGHEST for action security_group_rules [ 965.981990] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 with Priority: HIGHEST for action security_group_members [ 965.982135] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c54ea75f-f5fc-4b6e-bdf3-05617dfc3e23 with Priority: HIGHEST for action port [ 965.982497] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-35b651ef-47c8-4ff2-b472-9849f375b8c9 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.982637] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.982715] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.982919] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.983010] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('35b651ef-47c8-4ff2-b472-9849f375b8c9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.986025] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-35b651ef-47c8-4ff2-b472-9849f375b8c9 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.986025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.986025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.986025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.986025] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.986025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.986416] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.986416] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.986416] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.986416] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35b651ef-47c8-4ff2-b472-9849f375b8c9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.987923] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-c54ea75f-f5fc-4b6e-bdf3-05617dfc3e23 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.987923] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c54ea75f-f5fc-4b6e-bdf3-05617dfc3e23" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.988092] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c54ea75f-f5fc-4b6e-bdf3-05617dfc3e23" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.988139] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c54ea75f-f5fc-4b6e-bdf3-05617dfc3e23" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.988837] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c54ea75f-f5fc-4b6e-bdf3-05617dfc3e23',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.172884] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b5812c2b-73e7-421d-b4bb-29c4ef848f3f: rpc.has_security_group_logging(os_id): False [ 966.189700] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.189970] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.190079] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.190310] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.190439] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.190689] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.190793] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.190880] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.191050] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.191209] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.193065] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.193065] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.193065] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.193065] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.193065] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.193065] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.193065] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.193065] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.193065] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.193065] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.193065] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f is going to be updated. [ 966.280875] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.281049] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.281049] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.282023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.282023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.308034] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f in Status: IN_PROGRESS for 2s [ 966.485968] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-35b651ef-47c8-4ff2-b472-9849f375b8c9 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.486240] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.488562] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('35b651ef-47c8-4ff2-b472-9849f375b8c9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.489853] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c54ea75f-f5fc-4b6e-bdf3-05617dfc3e23 with status ACTIVE [ 966.490067] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.490167] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.490231] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.490429] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.490511] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.490672] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.490783] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.490835] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.490991] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.494025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.494025] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.494025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.494025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.494025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.494025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.494025] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c54ea75f-f5fc-4b6e-bdf3-05617dfc3e23 is going to be updated. [ 966.511472] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.511472] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.511655] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.512368] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.512368] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.512368] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c54ea75f-f5fc-4b6e-bdf3-05617dfc3e23" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.721827] env[68328]: INFO networking_nsxv3.common.synchronization [req-2f618f8c-3355-487c-b7df-2377cb70d4c9 req-ce4c94e1-c93e-4e51-bbb3-6baaf43dd438 tempest-DeleteServersTestJSON-1696259291 tempest-DeleteServersTestJSON-1696259291-project-member] Enqueued Resource ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 with Priority: HIGHEST for action security_group_members [ 966.722466] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 with Priority: HIGHEST for action security_group_members [ 966.722837] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.722970] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.723046] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.723259] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.723476] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.723562] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.723607] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.723815] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.723870] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.723962] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c35aa45-69e7-4952-b5d8-8a7d6b3460e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.946710] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da43fcb3-a053-41ce-ac92-ba868643fc4b in Status: SUCCESS [ 966.946710] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da43fcb3-a053-41ce-ac92-ba868643fc4b deletion is rescheduled due to dependency. [ 966.946710] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.991018] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('35b651ef-47c8-4ff2-b472-9849f375b8c9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.226037] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.226246] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.226338] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.226599] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.226731] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.226951] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.227097] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.227181] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.227381] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.227480] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.227590] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 is going to be updated. [ 967.262065] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.262065] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.262065] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.262065] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.262065] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.266861] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-280 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.267078] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-280" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.267195] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-280" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.267463] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-280" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.267767] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.267923] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.268052] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.268268] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.268418] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.268637] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 967.268752] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 967.268864] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 967.268980] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 967.269122] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 967.269236] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 967.269372] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 967.271329] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 in Status: IN_PROGRESS for 2s [ 967.292599] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 967.292776] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 967.292918] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 967.293115] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-280" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.293445] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-209535a5-4d28-4230-afa5-094cbc4a63e1 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.293619] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-209535a5-4d28-4230-afa5-094cbc4a63e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.293744] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-209535a5-4d28-4230-afa5-094cbc4a63e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.294092] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-209535a5-4d28-4230-afa5-094cbc4a63e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.294239] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('209535a5-4d28-4230-afa5-094cbc4a63e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.423371] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c5088e7-0ed1-4112-b902-8fd593a8b34e in Status: SUCCESS [ 967.424159] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c5088e7-0ed1-4112-b902-8fd593a8b34e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.424159] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c5088e7-0ed1-4112-b902-8fd593a8b34e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.424366] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c5088e7-0ed1-4112-b902-8fd593a8b34e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.424697] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.424955] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.425233] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.425501] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.425698] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.425842] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c5088e7-0ed1-4112-b902-8fd593a8b34e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.425979] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0c5088e7-0ed1-4112-b902-8fd593a8b34e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.477218] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28940b1a-276d-41ed-a135-91ce1b6e2b2c in Status: SUCCESS [ 967.477443] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.495130] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.495436] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.495436] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.495573] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.495661] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.495761] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 is going to be created. [ 967.522808] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.522961] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.523043] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.523262] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.523425] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.533020] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 in Status: UNINITIALIZED for 2s [ 967.798816] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.799070] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.799246] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.799697] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.799876] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.800065] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 209535a5-4d28-4230-afa5-094cbc4a63e1 not found, creating... [ 967.800355] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.800526] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.800648] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.800879] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.801034] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.801368] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.801534] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.801692] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.801955] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.802148] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.802301] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 209535a5-4d28-4230-afa5-094cbc4a63e1 is going to be created. [ 967.831814] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.832037] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.832170] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.832985] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.832985] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.832985] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-209535a5-4d28-4230-afa5-094cbc4a63e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.928610] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0c5088e7-0ed1-4112-b902-8fd593a8b34e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.324291] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f in Status: SUCCESS [ 968.324291] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.324291] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.324291] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.324291] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b5812c2b-73e7-421d-b4bb-29c4ef848f3f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.431976] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0c5088e7-0ed1-4112-b902-8fd593a8b34e: rpc.has_security_group_logging(os_id): False [ 968.455623] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.455761] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.455761] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.455967] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.456138] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.456466] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.456603] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.456726] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.456961] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.457099] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.457519] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c5088e7-0ed1-4112-b902-8fd593a8b34e is going to be created. [ 968.526208] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.526503] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.526503] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.527113] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.527113] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.547894] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c5088e7-0ed1-4112-b902-8fd593a8b34e in Status: IN_PROGRESS for 2s [ 968.665298] env[68328]: INFO networking_nsxv3.common.synchronization [req-2f618f8c-3355-487c-b7df-2377cb70d4c9 req-777a5609-c3f5-41c5-9cf2-be2a3c0af2c6 service nova] Enqueued Resource ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 with Priority: HIGHEST for action security_group_rules [ 968.665476] env[68328]: INFO networking_nsxv3.common.synchronization [req-2f618f8c-3355-487c-b7df-2377cb70d4c9 req-777a5609-c3f5-41c5-9cf2-be2a3c0af2c6 service nova] Enqueued Resource ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 with Priority: HIGHEST for action security_group_members [ 968.665629] env[68328]: INFO networking_nsxv3.common.synchronization [req-2f618f8c-3355-487c-b7df-2377cb70d4c9 req-777a5609-c3f5-41c5-9cf2-be2a3c0af2c6 service nova] Enqueued Resource ID: 209535a5-4d28-4230-afa5-094cbc4a63e1 with Priority: HIGHEST for action port [ 968.665897] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 with Priority: HIGHEST for action security_group_rules [ 968.666208] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 with Priority: HIGHEST for action security_group_members [ 968.666208] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 209535a5-4d28-4230-afa5-094cbc4a63e1 with Priority: HIGHEST for action port [ 968.666692] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.666819] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.666883] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.667645] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.667726] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c35aa45-69e7-4952-b5d8-8a7d6b3460e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.669136] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.669528] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.669749] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-209535a5-4d28-4230-afa5-094cbc4a63e1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.669951] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-209535a5-4d28-4230-afa5-094cbc4a63e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.669951] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-209535a5-4d28-4230-afa5-094cbc4a63e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.670155] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-209535a5-4d28-4230-afa5-094cbc4a63e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.670234] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('209535a5-4d28-4230-afa5-094cbc4a63e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.826701] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.827048] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.827223] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.827525] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.827760] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.827908] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.828011] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.828237] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.828365] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.828499] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.828634] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b5812c2b-73e7-421d-b4bb-29c4ef848f3f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.172258] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.172433] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.174787] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 209535a5-4d28-4230-afa5-094cbc4a63e1 with status ACTIVE [ 969.175013] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.175141] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.175237] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.175464] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.175556] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.175730] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.175875] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.175875] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.176068] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.176148] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.176328] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.176418] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.176478] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.176614] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.176686] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.176769] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 209535a5-4d28-4230-afa5-094cbc4a63e1 is going to be updated. [ 969.213112] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.213255] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.213317] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.213533] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.213668] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.213851] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-209535a5-4d28-4230-afa5-094cbc4a63e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.280051] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 in Status: SUCCESS [ 969.280277] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 deletion is rescheduled due to dependency. [ 969.280400] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.280550] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.281210] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.281210] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.281210] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.281210] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.281442] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.281442] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.281507] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c35aa45-69e7-4952-b5d8-8a7d6b3460e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.331631] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.331844] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.331965] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.332289] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.332539] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.332677] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.332767] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.333031] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.333142] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.333308] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.333511] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.333651] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.333737] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.333941] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.334166] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.334307] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.334400] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.334595] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.334712] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.334848] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.334985] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b5812c2b-73e7-421d-b4bb-29c4ef848f3f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.545832] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 in Status: SUCCESS [ 969.546220] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.546220] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.546444] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.546640] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.546758] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.546882] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.546968] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.547058] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.547140] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.547232] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('35b651ef-47c8-4ff2-b472-9849f375b8c9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.783534] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7c35aa45-69e7-4952-b5d8-8a7d6b3460e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.837219] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b5812c2b-73e7-421d-b4bb-29c4ef848f3f: rpc.has_security_group_logging(os_id): False [ 969.857669] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.857669] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.857857] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.857939] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.858044] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.858268] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.858472] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.858472] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.858578] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.858653] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.858822] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.859209] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.859209] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.859209] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.859209] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.859445] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.859510] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.859552] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.859696] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.859768] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.859885] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f is going to be updated. [ 969.924830] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.924830] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.924974] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.925191] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.925381] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.940997] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f in Status: IN_PROGRESS for 2s [ 970.049637] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('35b651ef-47c8-4ff2-b472-9849f375b8c9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.285419] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7c35aa45-69e7-4952-b5d8-8a7d6b3460e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.551734] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 35b651ef-47c8-4ff2-b472-9849f375b8c9: rpc.has_security_group_logging(os_id): False [ 970.561525] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c5088e7-0ed1-4112-b902-8fd593a8b34e in Status: SUCCESS [ 970.561766] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c5088e7-0ed1-4112-b902-8fd593a8b34e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.570027] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.570188] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.570261] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.570487] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.570575] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.570815] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.570936] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.571009] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.571195] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.571280] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.571367] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 is going to be created. [ 970.635599] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.635787] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.635898] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.636182] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.636400] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.646542] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 in Status: IN_PROGRESS for 2s [ 970.787506] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.787683] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.788187] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.788187] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.788187] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.788355] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 is going to be updated. [ 970.821932] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.822171] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.822240] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.822607] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.822861] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.833884] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 in Status: IN_PROGRESS for 2s [ 971.419104] env[68328]: INFO networking_nsxv3.common.synchronization [req-4f3877cc-5c3f-4ee5-bd42-2f88fa2b85cb req-55d4293b-52fd-4489-9a37-1301ded9ffda tempest-ImagesTestJSON-69996350 tempest-ImagesTestJSON-69996350-project-member] Enqueued Resource ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 with Priority: HIGHEST for action security_group_members [ 971.419651] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 with Priority: HIGHEST for action security_group_members [ 971.419965] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-249b36cf-74ee-44d9-b2c9-d728a30d9a09 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.420101] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.420171] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.420361] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.420534] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.420632] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.420690] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.420835] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.420916] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.421019] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('249b36cf-74ee-44d9-b2c9-d728a30d9a09',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.805751] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-834 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.806182] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-834" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.806182] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-834" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.806352] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-834" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.806614] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.806782] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.806905] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.807172] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.807324] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.807539] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 971.807657] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 971.807771] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 971.807883] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 971.809128] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 971.809128] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 971.809128] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 971.826471] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 971.826854] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 971.827323] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 971.827323] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-834" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.827649] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-b7eed6dc-6926-4c8e-91d3-98b779247ed3 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.827867] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-b7eed6dc-6926-4c8e-91d3-98b779247ed3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.828377] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-b7eed6dc-6926-4c8e-91d3-98b779247ed3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.828710] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-b7eed6dc-6926-4c8e-91d3-98b779247ed3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.828862] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7eed6dc-6926-4c8e-91d3-98b779247ed3',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.926798] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('249b36cf-74ee-44d9-b2c9-d728a30d9a09',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.956640] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f in Status: SUCCESS [ 971.957359] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.332528] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.332964] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.332964] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.333209] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.333371] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.333556] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port b7eed6dc-6926-4c8e-91d3-98b779247ed3 not found, creating... [ 972.333847] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.334020] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.334147] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.334381] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.334528] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.334817] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.334979] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.335138] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.335360] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.335505] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.335653] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: b7eed6dc-6926-4c8e-91d3-98b779247ed3 is going to be created. [ 972.358467] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.359079] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.359304] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.360312] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.360853] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.361217] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-b7eed6dc-6926-4c8e-91d3-98b779247ed3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.429566] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('249b36cf-74ee-44d9-b2c9-d728a30d9a09',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.657890] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 in Status: SUCCESS [ 972.658139] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.843053] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 in Status: SUCCESS [ 972.843434] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.843672] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.843826] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.844623] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.844623] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.844623] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.844623] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.844623] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.844623] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.844910] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7c35aa45-69e7-4952-b5d8-8a7d6b3460e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.933181] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.933339] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.936017] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.936017] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.936017] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.936017] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 is going to be updated. [ 972.959386] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.959570] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.959617] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.959833] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.959979] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.967883] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 in Status: IN_PROGRESS for 2s [ 973.277071] env[68328]: INFO networking_nsxv3.common.synchronization [req-4f3877cc-5c3f-4ee5-bd42-2f88fa2b85cb req-ee4c01e7-d2c6-40c2-91ea-b7ce1b470b3d service nova] Enqueued Resource ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 with Priority: HIGHEST for action security_group_rules [ 973.279139] env[68328]: INFO networking_nsxv3.common.synchronization [req-4f3877cc-5c3f-4ee5-bd42-2f88fa2b85cb req-ee4c01e7-d2c6-40c2-91ea-b7ce1b470b3d service nova] Enqueued Resource ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 with Priority: HIGHEST for action security_group_members [ 973.279139] env[68328]: INFO networking_nsxv3.common.synchronization [req-4f3877cc-5c3f-4ee5-bd42-2f88fa2b85cb req-ee4c01e7-d2c6-40c2-91ea-b7ce1b470b3d service nova] Enqueued Resource ID: b7eed6dc-6926-4c8e-91d3-98b779247ed3 with Priority: HIGHEST for action port [ 973.279139] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 with Priority: HIGHEST for action security_group_rules [ 973.279139] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 with Priority: HIGHEST for action security_group_members [ 973.279139] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7eed6dc-6926-4c8e-91d3-98b779247ed3 with Priority: HIGHEST for action port [ 973.279139] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-249b36cf-74ee-44d9-b2c9-d728a30d9a09 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.279139] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.279139] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.279851] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.280113] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('249b36cf-74ee-44d9-b2c9-d728a30d9a09',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.281219] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-249b36cf-74ee-44d9-b2c9-d728a30d9a09 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.281454] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.281750] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7eed6dc-6926-4c8e-91d3-98b779247ed3 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.287024] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7eed6dc-6926-4c8e-91d3-98b779247ed3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.287024] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7eed6dc-6926-4c8e-91d3-98b779247ed3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.287024] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7eed6dc-6926-4c8e-91d3-98b779247ed3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.287024] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7eed6dc-6926-4c8e-91d3-98b779247ed3',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.349596] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.349596] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.349596] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.349596] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.349596] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.349596] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.349596] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.349596] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.349596] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.349596] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.349596] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.349596] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.349596] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.349596] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.349596] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.349596] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.350334] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.350334] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.350334] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.350334] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.350334] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7c35aa45-69e7-4952-b5d8-8a7d6b3460e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.357443] env[68328]: INFO networking_nsxv3.common.synchronization [None req-599c320f-f22a-48aa-a947-b0163a77a474 None None] Enqueued Resource ID: a5767187-c42a-423a-bb1b-6f3f70fed122 with Priority: HIGHEST for action port [ 973.357924] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5767187-c42a-423a-bb1b-6f3f70fed122 with Priority: HIGHEST for action port [ 973.358381] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-a5767187-c42a-423a-bb1b-6f3f70fed122 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.358520] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a5767187-c42a-423a-bb1b-6f3f70fed122" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.358586] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a5767187-c42a-423a-bb1b-6f3f70fed122" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.358873] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a5767187-c42a-423a-bb1b-6f3f70fed122" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.358983] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5767187-c42a-423a-bb1b-6f3f70fed122',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.560665] env[68328]: INFO networking_nsxv3.common.synchronization [None req-50229e97-ad40-43bb-877d-12ad932932c8 tempest-ServerRescueNegativeTestJSON-1315865897 tempest-ServerRescueNegativeTestJSON-1315865897-project-member] Enqueued Resource ID: 9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a with Priority: HIGHEST for action security_group_rules [ 973.561371] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a with Priority: HIGHEST for action security_group_rules [ 973.564732] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.564732] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.564732] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.564732] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.564732] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.752930] env[68328]: INFO networking_nsxv3.common.synchronization [None req-887ffdfe-3e1b-4063-9b24-99672f01e828 tempest-ServerRescueNegativeTestJSON-1315865897 tempest-ServerRescueNegativeTestJSON-1315865897-project-member] Enqueued Resource ID: 9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a with Priority: HIGHEST for action security_group_rules [ 973.753746] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a with Priority: HIGHEST for action security_group_rules [ 973.753977] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.754218] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.787065] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-249b36cf-74ee-44d9-b2c9-d728a30d9a09 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.787198] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.787419] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b7eed6dc-6926-4c8e-91d3-98b779247ed3 with status ACTIVE [ 973.788164] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.788164] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.788164] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.788164] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.788164] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.788514] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.788514] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.788514] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.788688] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.788688] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.789330] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.789330] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.789330] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.789330] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.789330] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.789330] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b7eed6dc-6926-4c8e-91d3-98b779247ed3 is going to be updated. [ 973.811447] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.811635] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.812112] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.812112] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.812112] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.812249] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7eed6dc-6926-4c8e-91d3-98b779247ed3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.854845] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1: rpc.has_security_group_logging(os_id): False [ 973.862119] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a5767187-c42a-423a-bb1b-6f3f70fed122 [ 973.862476] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.862692] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.862809] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.863132] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.863279] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.863425] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a5767187-c42a-423a-bb1b-6f3f70fed122 already deleted. [ 973.863541] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a5767187-c42a-423a-bb1b-6f3f70fed122" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.878831] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.878831] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.878831] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.879060] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.879177] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.879517] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.879610] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.879610] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.880188] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.880188] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.880188] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.880188] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.880471] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.880471] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.880471] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.880648] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.880761] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.880796] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.881249] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.883130] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.883192] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 is going to be updated. [ 973.978487] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.978664] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.978702] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.978891] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.979210] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.993780] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 in Status: IN_PROGRESS for 2s [ 974.090921] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.091436] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.091549] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.091809] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.091949] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.092135] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a already deleted. [ 974.092233] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.092433] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.092643] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.094021] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.613882] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.614041] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.614119] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.614314] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.614400] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.614496] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a already deleted. [ 974.614577] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.977171] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 in Status: SUCCESS [ 974.977441] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.977594] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.977766] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.977949] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.978107] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.978139] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.978465] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.978578] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.978647] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('249b36cf-74ee-44d9-b2c9-d728a30d9a09',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.371287] env[68328]: INFO networking_nsxv3.common.synchronization [None req-80c7d037-ba62-4401-83fa-feaded5d7a4b None None] Enqueued Resource ID: 6c984331-1bd0-40d8-9353-b5c30a04cea3 with Priority: HIGHEST for action port [ 975.371287] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c984331-1bd0-40d8-9353-b5c30a04cea3 with Priority: HIGHEST for action port [ 975.372039] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c984331-1bd0-40d8-9353-b5c30a04cea3 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.372039] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c984331-1bd0-40d8-9353-b5c30a04cea3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.372039] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c984331-1bd0-40d8-9353-b5c30a04cea3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.373141] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c984331-1bd0-40d8-9353-b5c30a04cea3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.373249] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c984331-1bd0-40d8-9353-b5c30a04cea3',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.481903] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('249b36cf-74ee-44d9-b2c9-d728a30d9a09',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.877310] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6c984331-1bd0-40d8-9353-b5c30a04cea3 [ 975.878130] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.878130] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.878130] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.878130] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.878417] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.878417] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6c984331-1bd0-40d8-9353-b5c30a04cea3 already deleted. [ 975.878417] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c984331-1bd0-40d8-9353-b5c30a04cea3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.984985] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('249b36cf-74ee-44d9-b2c9-d728a30d9a09',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.008971] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 in Status: SUCCESS [ 976.008971] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.487902] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.488104] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.488180] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.488441] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.488497] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.488623] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 is going to be updated. [ 976.517474] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.517620] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.517674] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.517888] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.518050] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.526451] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 in Status: IN_PROGRESS for 2s [ 978.538437] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 in Status: SUCCESS [ 978.538437] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.538437] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.538437] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.538898] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.538898] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.538898] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.539583] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.540187] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.540187] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.540187] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('249b36cf-74ee-44d9-b2c9-d728a30d9a09',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.043177] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-249b36cf-74ee-44d9-b2c9-d728a30d9a09 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.043428] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.043678] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.043858] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.044072] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.044239] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.044303] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.044509] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.044652] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.044819] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.044960] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-249b36cf-74ee-44d9-b2c9-d728a30d9a09 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.045061] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.045216] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.045357] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.045505] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.045635] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.045716] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.045899] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.046251] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.046388] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.046488] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('249b36cf-74ee-44d9-b2c9-d728a30d9a09',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.428475] env[68328]: INFO networking_nsxv3.common.synchronization [req-65edff00-06e2-4569-8334-726e8833acff req-172fa5b3-7c4a-479d-9477-4b81f6a5c647 tempest-ServerActionsTestJSON-719988657 tempest-ServerActionsTestJSON-719988657-project-member] Enqueued Resource ID: 57513254-a6e5-4b1e-87b8-b529d35f4b6b with Priority: HIGHEST for action security_group_members [ 979.429231] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57513254-a6e5-4b1e-87b8-b529d35f4b6b with Priority: HIGHEST for action security_group_members [ 979.429594] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-57513254-a6e5-4b1e-87b8-b529d35f4b6b taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.429731] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57513254-a6e5-4b1e-87b8-b529d35f4b6b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.429798] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57513254-a6e5-4b1e-87b8-b529d35f4b6b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.430144] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57513254-a6e5-4b1e-87b8-b529d35f4b6b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.430950] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.430950] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.430950] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.430950] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.431199] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.431361] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57513254-a6e5-4b1e-87b8-b529d35f4b6b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.549343] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 249b36cf-74ee-44d9-b2c9-d728a30d9a09: rpc.has_security_group_logging(os_id): False [ 979.568231] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.568231] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.568231] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.568231] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.568231] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.568503] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.568612] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.568612] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.569749] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.569749] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.569749] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.569749] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.569749] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.569749] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.569749] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.569749] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.569749] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.570110] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.570110] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.570110] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.570297] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 is going to be updated. [ 979.628549] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.628549] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.628549] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.628549] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.628549] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.643736] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 in Status: IN_PROGRESS for 2s [ 979.751840] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-74 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.752056] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-74" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.752195] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-74" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.752510] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-74" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.752765] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.752946] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.753083] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.753346] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.753527] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.753755] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 979.753900] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 979.754036] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 979.754157] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 979.754279] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 979.754394] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 979.754547] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 979.783332] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 979.783524] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 979.783688] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 979.783873] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-74" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.784219] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-b09caef6-0372-4e45-9f77-4712320ea223 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.784399] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-b09caef6-0372-4e45-9f77-4712320ea223" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.784519] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-b09caef6-0372-4e45-9f77-4712320ea223" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.784874] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-b09caef6-0372-4e45-9f77-4712320ea223" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.785049] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b09caef6-0372-4e45-9f77-4712320ea223',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.934998] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.935210] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.935305] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.935548] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.935652] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.935978] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.935978] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.936143] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.936207] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.936282] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.936371] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57513254-a6e5-4b1e-87b8-b529d35f4b6b already deleted. [ 979.936451] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57513254-a6e5-4b1e-87b8-b529d35f4b6b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.288119] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.288625] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.289935] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.289935] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.289935] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.289935] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port b09caef6-0372-4e45-9f77-4712320ea223 not found, creating... [ 980.290221] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.290221] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.290327] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.290900] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.291023] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.291313] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.291519] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.291645] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.291942] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.292104] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.292268] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: b09caef6-0372-4e45-9f77-4712320ea223 is going to be created. [ 980.312085] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.312399] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.312530] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.312949] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.312995] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.313276] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-b09caef6-0372-4e45-9f77-4712320ea223" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.345451] env[68328]: INFO networking_nsxv3.common.synchronization [req-f7aa20c5-fa41-4bf4-8b53-e2a51cd69124 req-a582c325-68b9-44f1-9931-8fbedc941e62 tempest-ServerRescueTestJSONUnderV235-188857036 tempest-ServerRescueTestJSONUnderV235-188857036-project-member] Enqueued Resource ID: f8b37b70-8a6c-47a3-a0af-8fe826c63e8a with Priority: HIGHEST for action security_group_members [ 980.345643] env[68328]: INFO networking_nsxv3.common.synchronization [req-f7aa20c5-fa41-4bf4-8b53-e2a51cd69124 req-a582c325-68b9-44f1-9931-8fbedc941e62 tempest-ServerRescueTestJSONUnderV235-188857036 tempest-ServerRescueTestJSONUnderV235-188857036-project-member] Enqueued Resource ID: 28940b1a-276d-41ed-a135-91ce1b6e2b2c with Priority: HIGHEST for action security_group_members [ 980.346155] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8b37b70-8a6c-47a3-a0af-8fe826c63e8a with Priority: HIGHEST for action security_group_members [ 980.346293] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28940b1a-276d-41ed-a135-91ce1b6e2b2c with Priority: HIGHEST for action security_group_members [ 980.346763] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8b37b70-8a6c-47a3-a0af-8fe826c63e8a taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.346914] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8b37b70-8a6c-47a3-a0af-8fe826c63e8a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.346984] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8b37b70-8a6c-47a3-a0af-8fe826c63e8a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.347254] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8b37b70-8a6c-47a3-a0af-8fe826c63e8a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.347422] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.347945] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.348028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.348194] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.348502] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.348502] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8b37b70-8a6c-47a3-a0af-8fe826c63e8a',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.349296] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-28940b1a-276d-41ed-a135-91ce1b6e2b2c taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.349415] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.349468] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.349675] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.349803] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.349895] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.349955] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.350174] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.350315] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.350365] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28940b1a-276d-41ed-a135-91ce1b6e2b2c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.400448] env[68328]: INFO networking_nsxv3.common.synchronization [req-f7aa20c5-fa41-4bf4-8b53-e2a51cd69124 req-a582c325-68b9-44f1-9931-8fbedc941e62 tempest-ServerRescueTestJSONUnderV235-188857036 tempest-ServerRescueTestJSONUnderV235-188857036-project-member] Enqueued Resource ID: 28940b1a-276d-41ed-a135-91ce1b6e2b2c with Priority: HIGHEST for action security_group_rules [ 980.400659] env[68328]: INFO networking_nsxv3.common.synchronization [req-f7aa20c5-fa41-4bf4-8b53-e2a51cd69124 req-a582c325-68b9-44f1-9931-8fbedc941e62 tempest-ServerRescueTestJSONUnderV235-188857036 tempest-ServerRescueTestJSONUnderV235-188857036-project-member] Enqueued Resource ID: 28940b1a-276d-41ed-a135-91ce1b6e2b2c with Priority: HIGHEST for action security_group_members [ 980.400803] env[68328]: INFO networking_nsxv3.common.synchronization [req-f7aa20c5-fa41-4bf4-8b53-e2a51cd69124 req-a582c325-68b9-44f1-9931-8fbedc941e62 tempest-ServerRescueTestJSONUnderV235-188857036 tempest-ServerRescueTestJSONUnderV235-188857036-project-member] Enqueued Resource ID: f8b37b70-8a6c-47a3-a0af-8fe826c63e8a with Priority: HIGHEST for action security_group_rules [ 980.400938] env[68328]: INFO networking_nsxv3.common.synchronization [req-f7aa20c5-fa41-4bf4-8b53-e2a51cd69124 req-a582c325-68b9-44f1-9931-8fbedc941e62 tempest-ServerRescueTestJSONUnderV235-188857036 tempest-ServerRescueTestJSONUnderV235-188857036-project-member] Enqueued Resource ID: f8b37b70-8a6c-47a3-a0af-8fe826c63e8a with Priority: HIGHEST for action security_group_members [ 980.401091] env[68328]: INFO networking_nsxv3.common.synchronization [req-f7aa20c5-fa41-4bf4-8b53-e2a51cd69124 req-a582c325-68b9-44f1-9931-8fbedc941e62 tempest-ServerRescueTestJSONUnderV235-188857036 tempest-ServerRescueTestJSONUnderV235-188857036-project-member] Enqueued Resource ID: c81326a7-7335-4ca9-8c56-3e0880115c43 with Priority: HIGHEST for action port [ 980.402391] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28940b1a-276d-41ed-a135-91ce1b6e2b2c with Priority: HIGHEST for action security_group_rules [ 980.402702] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8b37b70-8a6c-47a3-a0af-8fe826c63e8a with Priority: HIGHEST for action security_group_rules [ 980.402702] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c81326a7-7335-4ca9-8c56-3e0880115c43 with Priority: HIGHEST for action port [ 980.402955] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28940b1a-276d-41ed-a135-91ce1b6e2b2c with Priority: HIGHEST for action security_group_members [ 980.402955] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8b37b70-8a6c-47a3-a0af-8fe826c63e8a with Priority: HIGHEST for action security_group_members [ 980.403175] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28940b1a-276d-41ed-a135-91ce1b6e2b2c taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.403251] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.403309] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.403512] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.403619] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28940b1a-276d-41ed-a135-91ce1b6e2b2c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.404617] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8b37b70-8a6c-47a3-a0af-8fe826c63e8a taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.404805] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8b37b70-8a6c-47a3-a0af-8fe826c63e8a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.404805] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8b37b70-8a6c-47a3-a0af-8fe826c63e8a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.404949] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8b37b70-8a6c-47a3-a0af-8fe826c63e8a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.405041] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8b37b70-8a6c-47a3-a0af-8fe826c63e8a',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.406424] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-c81326a7-7335-4ca9-8c56-3e0880115c43 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.406569] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c81326a7-7335-4ca9-8c56-3e0880115c43" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.406569] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c81326a7-7335-4ca9-8c56-3e0880115c43" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.406727] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c81326a7-7335-4ca9-8c56-3e0880115c43" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.406788] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c81326a7-7335-4ca9-8c56-3e0880115c43',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.407749] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-28940b1a-276d-41ed-a135-91ce1b6e2b2c taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.407749] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.407999] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8b37b70-8a6c-47a3-a0af-8fe826c63e8a taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.407999] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8b37b70-8a6c-47a3-a0af-8fe826c63e8a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.852543] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8b37b70-8a6c-47a3-a0af-8fe826c63e8a',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.855253] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('28940b1a-276d-41ed-a135-91ce1b6e2b2c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.909061] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8b37b70-8a6c-47a3-a0af-8fe826c63e8a taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.909615] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8b37b70-8a6c-47a3-a0af-8fe826c63e8a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.909893] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c81326a7-7335-4ca9-8c56-3e0880115c43 with status ACTIVE [ 980.910098] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.910217] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.910284] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.910543] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.910675] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.910883] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.910980] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.911052] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.911254] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.911322] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.911523] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.911618] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.911677] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.911823] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.911917] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.912033] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c81326a7-7335-4ca9-8c56-3e0880115c43 is going to be updated. [ 980.913429] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-28940b1a-276d-41ed-a135-91ce1b6e2b2c taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.914120] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.938033] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.938430] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.938542] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.938791] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.938975] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.939644] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c81326a7-7335-4ca9-8c56-3e0880115c43" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.047604] env[68328]: INFO networking_nsxv3.common.synchronization [req-65edff00-06e2-4569-8334-726e8833acff req-4d3d90da-106d-4967-ad48-76d390f2a418 service nova] Enqueued Resource ID: 57513254-a6e5-4b1e-87b8-b529d35f4b6b with Priority: HIGHEST for action security_group_rules [ 981.047604] env[68328]: INFO networking_nsxv3.common.synchronization [req-65edff00-06e2-4569-8334-726e8833acff req-4d3d90da-106d-4967-ad48-76d390f2a418 service nova] Enqueued Resource ID: 57513254-a6e5-4b1e-87b8-b529d35f4b6b with Priority: HIGHEST for action security_group_members [ 981.047604] env[68328]: INFO networking_nsxv3.common.synchronization [req-65edff00-06e2-4569-8334-726e8833acff req-4d3d90da-106d-4967-ad48-76d390f2a418 service nova] Enqueued Resource ID: b09caef6-0372-4e45-9f77-4712320ea223 with Priority: HIGHEST for action port [ 981.047604] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57513254-a6e5-4b1e-87b8-b529d35f4b6b with Priority: HIGHEST for action security_group_rules [ 981.047604] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57513254-a6e5-4b1e-87b8-b529d35f4b6b with Priority: HIGHEST for action security_group_members [ 981.047604] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b09caef6-0372-4e45-9f77-4712320ea223 with Priority: HIGHEST for action port [ 981.053323] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57513254-a6e5-4b1e-87b8-b529d35f4b6b taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.053482] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57513254-a6e5-4b1e-87b8-b529d35f4b6b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.053761] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57513254-a6e5-4b1e-87b8-b529d35f4b6b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.053761] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57513254-a6e5-4b1e-87b8-b529d35f4b6b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.053877] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57513254-a6e5-4b1e-87b8-b529d35f4b6b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.056601] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-57513254-a6e5-4b1e-87b8-b529d35f4b6b taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.056779] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57513254-a6e5-4b1e-87b8-b529d35f4b6b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.056821] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57513254-a6e5-4b1e-87b8-b529d35f4b6b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.056990] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57513254-a6e5-4b1e-87b8-b529d35f4b6b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.057749] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.057749] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.057749] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.057749] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.057749] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.057749] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57513254-a6e5-4b1e-87b8-b529d35f4b6b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.059636] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-b09caef6-0372-4e45-9f77-4712320ea223 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.059636] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b09caef6-0372-4e45-9f77-4712320ea223" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.059636] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b09caef6-0372-4e45-9f77-4712320ea223" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.059636] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b09caef6-0372-4e45-9f77-4712320ea223" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.059636] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b09caef6-0372-4e45-9f77-4712320ea223',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.097311] env[68328]: INFO networking_nsxv3.common.synchronization [req-46eb85f4-b87b-4ab7-98ef-fdeb44aed99a req-1494feb1-278d-42c9-aaca-cd9a7cf2be28 tempest-ServerRescueTestJSONUnderV235-188857036 tempest-ServerRescueTestJSONUnderV235-188857036-project-member] Enqueued Resource ID: f8b37b70-8a6c-47a3-a0af-8fe826c63e8a with Priority: HIGHEST for action security_group_members [ 981.097496] env[68328]: INFO networking_nsxv3.common.synchronization [req-46eb85f4-b87b-4ab7-98ef-fdeb44aed99a req-1494feb1-278d-42c9-aaca-cd9a7cf2be28 tempest-ServerRescueTestJSONUnderV235-188857036 tempest-ServerRescueTestJSONUnderV235-188857036-project-member] Enqueued Resource ID: 28940b1a-276d-41ed-a135-91ce1b6e2b2c with Priority: HIGHEST for action security_group_members [ 981.098171] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8b37b70-8a6c-47a3-a0af-8fe826c63e8a with Priority: HIGHEST for action security_group_members [ 981.098311] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28940b1a-276d-41ed-a135-91ce1b6e2b2c with Priority: HIGHEST for action security_group_members [ 981.098594] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8b37b70-8a6c-47a3-a0af-8fe826c63e8a taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.098715] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8b37b70-8a6c-47a3-a0af-8fe826c63e8a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.099014] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-28940b1a-276d-41ed-a135-91ce1b6e2b2c taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.101311] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.175203] env[68328]: INFO networking_nsxv3.common.synchronization [req-46eb85f4-b87b-4ab7-98ef-fdeb44aed99a req-1494feb1-278d-42c9-aaca-cd9a7cf2be28 tempest-ServerRescueTestJSONUnderV235-188857036 tempest-ServerRescueTestJSONUnderV235-188857036-project-member] Enqueued Resource ID: 28940b1a-276d-41ed-a135-91ce1b6e2b2c with Priority: HIGHEST for action security_group_rules [ 981.175342] env[68328]: INFO networking_nsxv3.common.synchronization [req-46eb85f4-b87b-4ab7-98ef-fdeb44aed99a req-1494feb1-278d-42c9-aaca-cd9a7cf2be28 tempest-ServerRescueTestJSONUnderV235-188857036 tempest-ServerRescueTestJSONUnderV235-188857036-project-member] Enqueued Resource ID: 28940b1a-276d-41ed-a135-91ce1b6e2b2c with Priority: HIGHEST for action security_group_members [ 981.175739] env[68328]: INFO networking_nsxv3.common.synchronization [req-46eb85f4-b87b-4ab7-98ef-fdeb44aed99a req-1494feb1-278d-42c9-aaca-cd9a7cf2be28 tempest-ServerRescueTestJSONUnderV235-188857036 tempest-ServerRescueTestJSONUnderV235-188857036-project-member] Enqueued Resource ID: c81326a7-7335-4ca9-8c56-3e0880115c43 with Priority: HIGHEST for action port [ 981.176284] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28940b1a-276d-41ed-a135-91ce1b6e2b2c with Priority: HIGHEST for action security_group_rules [ 981.176423] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28940b1a-276d-41ed-a135-91ce1b6e2b2c with Priority: HIGHEST for action security_group_members [ 981.176521] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c81326a7-7335-4ca9-8c56-3e0880115c43 with Priority: HIGHEST for action port [ 981.176801] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28940b1a-276d-41ed-a135-91ce1b6e2b2c taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.176904] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.177113] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-28940b1a-276d-41ed-a135-91ce1b6e2b2c taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.177191] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.177372] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-c81326a7-7335-4ca9-8c56-3e0880115c43 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.177556] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c81326a7-7335-4ca9-8c56-3e0880115c43" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.177556] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c81326a7-7335-4ca9-8c56-3e0880115c43" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.177738] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c81326a7-7335-4ca9-8c56-3e0880115c43" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.177805] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c81326a7-7335-4ca9-8c56-3e0880115c43',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.357898] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8b37b70-8a6c-47a3-a0af-8fe826c63e8a',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.358323] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('28940b1a-276d-41ed-a135-91ce1b6e2b2c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.561207] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57513254-a6e5-4b1e-87b8-b529d35f4b6b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.562733] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-57513254-a6e5-4b1e-87b8-b529d35f4b6b taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.562874] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57513254-a6e5-4b1e-87b8-b529d35f4b6b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.564331] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b09caef6-0372-4e45-9f77-4712320ea223 with status ACTIVE [ 981.564687] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.564814] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.565157] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.565489] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.565621] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.565865] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.569617] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.569761] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.569983] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.570138] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.570447] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.570608] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.570698] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.570895] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.571009] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.571453] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b09caef6-0372-4e45-9f77-4712320ea223 is going to be updated. [ 981.592992] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.593208] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.593316] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.593587] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.593761] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.594052] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b09caef6-0372-4e45-9f77-4712320ea223" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.663905] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 in Status: SUCCESS [ 981.664149] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.682617] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c81326a7-7335-4ca9-8c56-3e0880115c43 with status ACTIVE [ 981.682617] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.682617] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.682617] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.682617] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.682617] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.682617] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.682617] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.682617] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.682617] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.682617] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.682617] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.682617] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.682617] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.682617] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.682617] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.682617] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c81326a7-7335-4ca9-8c56-3e0880115c43 is going to be updated. [ 981.714477] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.714477] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.714477] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.714477] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.714477] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.714477] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c81326a7-7335-4ca9-8c56-3e0880115c43" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.858218] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.858534] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.858578] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.858787] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.858879] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.859250] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8b37b70-8a6c-47a3-a0af-8fe826c63e8a is going to be created. [ 981.861028] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.861172] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.861241] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.861505] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.861591] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.861753] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28940b1a-276d-41ed-a135-91ce1b6e2b2c is going to be updated. [ 981.898046] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.898270] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.898348] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.898580] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.898763] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.914969] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8b37b70-8a6c-47a3-a0af-8fe826c63e8a in Status: UNINITIALIZED for 2s [ 981.918928] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.919103] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.919265] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.919488] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.919640] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.934230] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28940b1a-276d-41ed-a135-91ce1b6e2b2c in Status: IN_PROGRESS for 2s [ 982.074168] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57513254-a6e5-4b1e-87b8-b529d35f4b6b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.577400] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.579910] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.579910] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.579910] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.579910] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.579910] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57513254-a6e5-4b1e-87b8-b529d35f4b6b is going to be created. [ 982.618970] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.618970] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.618970] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.618970] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.618970] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.651376] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57513254-a6e5-4b1e-87b8-b529d35f4b6b in Status: UNINITIALIZED for 2s [ 983.698265] env[68328]: INFO networking_nsxv3.common.synchronization [req-2b465637-e414-4a95-bf79-546e69365981 req-d5b4dffd-d22f-45bd-b050-11e8fe57b479 tempest-MigrationsAdminTest-1924704487 tempest-MigrationsAdminTest-1924704487-project-member] Enqueued Resource ID: ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 with Priority: HIGHEST for action security_group_members [ 983.698808] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 with Priority: HIGHEST for action security_group_members [ 983.699208] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.699384] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.699450] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.699662] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.699817] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.699975] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.699975] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.700114] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.700207] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.700279] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ccbebeb4-60d7-4344-b96e-b9dfdeae14b1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.929460] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8b37b70-8a6c-47a3-a0af-8fe826c63e8a in Status: SUCCESS [ 983.929928] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8b37b70-8a6c-47a3-a0af-8fe826c63e8a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.929928] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8b37b70-8a6c-47a3-a0af-8fe826c63e8a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.930263] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8b37b70-8a6c-47a3-a0af-8fe826c63e8a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.930550] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.930640] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.930695] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.930873] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.930970] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.931106] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8b37b70-8a6c-47a3-a0af-8fe826c63e8a',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.945328] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28940b1a-276d-41ed-a135-91ce1b6e2b2c in Status: SUCCESS [ 983.946049] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.946267] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.946470] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.946759] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.946895] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.946965] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.947153] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.947240] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.947337] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28940b1a-276d-41ed-a135-91ce1b6e2b2c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.182254] env[68328]: INFO networking_nsxv3.common.synchronization [req-955269a3-c6e7-4af5-a643-f60bef7a860b req-befeaa50-cdb7-41f0-8157-d23d0e7ec407 tempest-ListServerFiltersTestJSON-1110536152 tempest-ListServerFiltersTestJSON-1110536152-project-member] Enqueued Resource ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f with Priority: HIGHEST for action security_group_members [ 984.182852] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f with Priority: HIGHEST for action security_group_members [ 984.183178] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.183306] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.183386] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.183609] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.183777] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.183878] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.183941] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.187754] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.188220] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.188374] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5812c2b-73e7-421d-b4bb-29c4ef848f3f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.202769] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.203048] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.203290] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.203437] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.205559] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.205559] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.205559] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.205559] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.205559] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.205559] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.205559] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 is going to be updated. [ 984.238633] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.238633] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.238633] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.238633] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.238633] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.251778] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 in Status: IN_PROGRESS for 2s [ 984.435668] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.435955] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.436718] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.437069] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.437172] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.437393] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.437496] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.437558] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.437717] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.437923] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.437923] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8b37b70-8a6c-47a3-a0af-8fe826c63e8a is going to be deleted. [ 984.452802] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('28940b1a-276d-41ed-a135-91ce1b6e2b2c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.471449] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.471664] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.471775] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.472094] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.472232] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.472490] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8b37b70-8a6c-47a3-a0af-8fe826c63e8a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.472618] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8b37b70-8a6c-47a3-a0af-8fe826c63e8a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.472884] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8b37b70-8a6c-47a3-a0af-8fe826c63e8a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.473206] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.474735] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.474735] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.474735] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.474735] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.474735] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8b37b70-8a6c-47a3-a0af-8fe826c63e8a',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.663764] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57513254-a6e5-4b1e-87b8-b529d35f4b6b in Status: SUCCESS [ 984.664012] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57513254-a6e5-4b1e-87b8-b529d35f4b6b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.664194] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57513254-a6e5-4b1e-87b8-b529d35f4b6b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.664429] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57513254-a6e5-4b1e-87b8-b529d35f4b6b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.664656] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.664785] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.664834] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.664968] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.665063] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.665154] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57513254-a6e5-4b1e-87b8-b529d35f4b6b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.665245] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57513254-a6e5-4b1e-87b8-b529d35f4b6b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.693371] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b5812c2b-73e7-421d-b4bb-29c4ef848f3f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.955176] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('28940b1a-276d-41ed-a135-91ce1b6e2b2c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.981568] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.981834] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.981834] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.982059] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.982155] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.982376] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.982497] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.982563] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.982724] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.982803] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.982911] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8b37b70-8a6c-47a3-a0af-8fe826c63e8a already deleted. [ 984.982976] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8b37b70-8a6c-47a3-a0af-8fe826c63e8a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.983089] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f8b37b70-8a6c-47a3-a0af-8fe826c63e8a',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.984866] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8b37b70-8a6c-47a3-a0af-8fe826c63e8a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.985162] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8b37b70-8a6c-47a3-a0af-8fe826c63e8a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.985355] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.985508] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.985561] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.985675] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.985753] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.985844] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8b37b70-8a6c-47a3-a0af-8fe826c63e8a',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.169522] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57513254-a6e5-4b1e-87b8-b529d35f4b6b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.194820] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b5812c2b-73e7-421d-b4bb-29c4ef848f3f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.458894] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.458894] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.459468] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.459884] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.460119] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.460570] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28940b1a-276d-41ed-a135-91ce1b6e2b2c is going to be updated. [ 985.488885] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f8b37b70-8a6c-47a3-a0af-8fe826c63e8a',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.489998] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.489998] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.489998] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.489998] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.490240] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.490338] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.490445] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.490539] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.490794] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.490881] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.495461] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8b37b70-8a6c-47a3-a0af-8fe826c63e8a already deleted. [ 985.495461] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8b37b70-8a6c-47a3-a0af-8fe826c63e8a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.497029] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.497029] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.497029] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.497524] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.497829] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.513230] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28940b1a-276d-41ed-a135-91ce1b6e2b2c in Status: IN_PROGRESS for 2s [ 985.676310] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57513254-a6e5-4b1e-87b8-b529d35f4b6b: rpc.has_security_group_logging(os_id): False [ 985.698467] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.698663] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.698768] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.699069] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.699512] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.699591] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.699664] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.699889] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.699970] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.700121] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.700232] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57513254-a6e5-4b1e-87b8-b529d35f4b6b is going to be created. [ 985.702072] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.702248] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.702358] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.702579] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.702642] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.702735] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f is going to be updated. [ 985.732770] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.732977] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.733040] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.733317] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.733563] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.750680] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f in Status: IN_PROGRESS for 2s [ 985.761550] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.762032] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.762172] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.762401] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.764110] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.778777] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57513254-a6e5-4b1e-87b8-b529d35f4b6b in Status: IN_PROGRESS for 2s [ 986.000948] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f8b37b70-8a6c-47a3-a0af-8fe826c63e8a: rpc.has_security_group_logging(os_id): False [ 986.019502] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.019777] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.019873] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.020090] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.020260] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.020421] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.020524] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.020736] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.020810] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.020843] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.020918] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8b37b70-8a6c-47a3-a0af-8fe826c63e8a is going to be created. [ 986.041015] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/f8b37b70-8a6c-47a3-a0af-8fe826c63e8a], does not exist path=[/infra/domains/default/groups/f8b37b70-8a6c-47a3-a0af-8fe826c63e8a]."\n}' [ 986.041186] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8b37b70-8a6c-47a3-a0af-8fe826c63e8a failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/f8b37b70-8a6c-47a3-a0af-8fe826c63e8a [ 986.041354] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 986.077527] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.077704] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.077771] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.077987] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.081545] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.082049] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.082158] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.082158] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.082367] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.082507] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.082707] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.082834] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.082924] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.083033] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.083102] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.083186] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8b37b70-8a6c-47a3-a0af-8fe826c63e8a is going to be created. [ 986.104439] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/f8b37b70-8a6c-47a3-a0af-8fe826c63e8a], does not exist path=[/infra/domains/default/groups/f8b37b70-8a6c-47a3-a0af-8fe826c63e8a]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/f8b37b70-8a6c-47a3-a0af-8fe826c63e8a [ 986.104439] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8b37b70-8a6c-47a3-a0af-8fe826c63e8a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.104439] env[68328]: Traceback (most recent call last): [ 986.104439] env[68328]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 986.104439] env[68328]: return func(*args, **kwargs) [ 986.104439] env[68328]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 986.104439] env[68328]: res.raise_for_status() [ 986.104439] env[68328]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 986.104439] env[68328]: raise HTTPError(http_error_msg, response=self) [ 986.104439] env[68328]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/f8b37b70-8a6c-47a3-a0af-8fe826c63e8a [ 986.104439] env[68328]: During handling of the above exception, another exception occurred: [ 986.104439] env[68328]: Traceback (most recent call last): [ 986.104439] env[68328]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 986.104439] env[68328]: listener.cb(fileno) [ 986.104439] env[68328]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 986.104439] env[68328]: result = function(*args, **kwargs) [ 986.104439] env[68328]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 986.104439] env[68328]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 986.104439] env[68328]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 986.104439] env[68328]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 986.104439] env[68328]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 986.104439] env[68328]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 986.104439] env[68328]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 986.104439] env[68328]: res.raise_for_status() [ 986.104439] env[68328]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 986.104439] env[68328]: raise HTTPError(http_error_msg, response=self) [ 986.104439] env[68328]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/f8b37b70-8a6c-47a3-a0af-8fe826c63e8a [ 986.104439] env[68328]: Removing descriptor: 27 [ 986.263831] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 in Status: SUCCESS [ 986.264155] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 deletion is rescheduled due to dependency. [ 986.264415] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.522920] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28940b1a-276d-41ed-a135-91ce1b6e2b2c in Status: SUCCESS [ 987.523283] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.523469] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.523694] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.523894] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.524571] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.524650] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.524808] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.524894] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.524979] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.525089] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('28940b1a-276d-41ed-a135-91ce1b6e2b2c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.525947] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.526117] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.526285] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.526385] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.526446] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.526582] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.526657] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.526740] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28940b1a-276d-41ed-a135-91ce1b6e2b2c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.763684] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f in Status: SUCCESS [ 987.764352] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.790665] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57513254-a6e5-4b1e-87b8-b529d35f4b6b in Status: SUCCESS [ 987.791848] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57513254-a6e5-4b1e-87b8-b529d35f4b6b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.032241] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-28940b1a-276d-41ed-a135-91ce1b6e2b2c taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.032241] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.032241] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('28940b1a-276d-41ed-a135-91ce1b6e2b2c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.533359] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('28940b1a-276d-41ed-a135-91ce1b6e2b2c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.035802] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.035802] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.036120] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.036120] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.036265] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.036324] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28940b1a-276d-41ed-a135-91ce1b6e2b2c is going to be updated. [ 989.067946] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.068113] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.068239] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.068470] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.068550] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.082303] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28940b1a-276d-41ed-a135-91ce1b6e2b2c in Status: IN_PROGRESS for 2s [ 989.184206] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 989.184206] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 990.000154] env[68328]: INFO networking_nsxv3.common.synchronization [req-829698d7-6bd6-44e9-8fdf-20e47007ff2e req-2d01901e-e65d-4a07-b80f-cd6f4b43ca95 tempest-ServerMetadataNegativeTestJSON-1733751753 tempest-ServerMetadataNegativeTestJSON-1733751753-project-member] Enqueued Resource ID: 136bcfc4-bc92-46ea-9e01-01b9a11704ee with Priority: HIGHEST for action security_group_members [ 990.000682] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 136bcfc4-bc92-46ea-9e01-01b9a11704ee with Priority: HIGHEST for action security_group_members [ 990.000990] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-136bcfc4-bc92-46ea-9e01-01b9a11704ee taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.001119] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-136bcfc4-bc92-46ea-9e01-01b9a11704ee" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.001229] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-136bcfc4-bc92-46ea-9e01-01b9a11704ee" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.001501] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-136bcfc4-bc92-46ea-9e01-01b9a11704ee" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.002022] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.002022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.002022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.002232] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.002232] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.002298] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('136bcfc4-bc92-46ea-9e01-01b9a11704ee',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.060064] env[68328]: INFO networking_nsxv3.common.synchronization [req-51f7b103-15d7-4a6f-a431-3576c38594df req-67f45455-579f-4afb-a7d0-79aa4462c756 tempest-ServerRescueTestJSONUnderV235-188857036 tempest-ServerRescueTestJSONUnderV235-188857036-project-member] Enqueued Resource ID: 28940b1a-276d-41ed-a135-91ce1b6e2b2c with Priority: HIGHEST for action security_group_members [ 990.060566] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28940b1a-276d-41ed-a135-91ce1b6e2b2c with Priority: HIGHEST for action security_group_members [ 990.060880] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-28940b1a-276d-41ed-a135-91ce1b6e2b2c taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.060984] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.498058] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-151 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.498277] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-151" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.498409] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-151" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.498745] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-151" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.499080] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.499412] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.499584] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.499851] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.500103] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.500358] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 990.500506] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 990.500648] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 990.500787] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 990.500931] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 990.501079] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 990.501268] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 990.504763] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.504976] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.505203] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.506107] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.506272] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.506661] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.506830] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.506980] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.507201] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.507314] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.507427] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 136bcfc4-bc92-46ea-9e01-01b9a11704ee already deleted. [ 990.507538] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-136bcfc4-bc92-46ea-9e01-01b9a11704ee" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.522358] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 990.522999] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 990.523314] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 990.523590] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-151" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.523925] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-aba774fd-cc3c-42b2-bd1f-b612806350db taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.524659] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-aba774fd-cc3c-42b2-bd1f-b612806350db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.524659] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-aba774fd-cc3c-42b2-bd1f-b612806350db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.524778] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-aba774fd-cc3c-42b2-bd1f-b612806350db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.524965] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aba774fd-cc3c-42b2-bd1f-b612806350db',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.030763] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.030763] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.030763] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.030763] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.031349] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.031349] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port aba774fd-cc3c-42b2-bd1f-b612806350db not found, creating... [ 991.031424] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.031572] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.031729] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.031919] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.032076] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.032374] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.032560] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.032688] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.032903] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.035989] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.036543] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: aba774fd-cc3c-42b2-bd1f-b612806350db is going to be created. [ 991.057277] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.057277] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.057277] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.057277] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.057277] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.057277] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-aba774fd-cc3c-42b2-bd1f-b612806350db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.091945] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28940b1a-276d-41ed-a135-91ce1b6e2b2c in Status: SUCCESS [ 991.095160] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.095160] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.095160] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.095160] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.095160] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.095160] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.095160] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.095160] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.095160] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28940b1a-276d-41ed-a135-91ce1b6e2b2c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.304047] env[68328]: INFO networking_nsxv3.common.synchronization [None req-d07c38d7-1b0f-4d85-aec9-a56a040fc47c None None] Enqueued Resource ID: 06037bb8-e014-4666-b9a5-57a1c338d994 with Priority: HIGHEST for action port [ 991.304329] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06037bb8-e014-4666-b9a5-57a1c338d994 with Priority: HIGHEST for action port [ 991.304902] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-06037bb8-e014-4666-b9a5-57a1c338d994 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.305051] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06037bb8-e014-4666-b9a5-57a1c338d994" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.305250] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06037bb8-e014-4666-b9a5-57a1c338d994" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.305359] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06037bb8-e014-4666-b9a5-57a1c338d994" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.305457] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06037bb8-e014-4666-b9a5-57a1c338d994',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.312683] env[68328]: INFO networking_nsxv3.common.synchronization [req-dd9802fe-d4e0-450a-90a1-c94af79da330 req-95df2336-5fe8-4ecb-acd7-41c85d8bd198 tempest-ImagesTestJSON-69996350 tempest-ImagesTestJSON-69996350-project-member] Enqueued Resource ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 with Priority: HIGHEST for action security_group_members [ 991.313539] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 with Priority: HIGHEST for action security_group_members [ 991.313911] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-249b36cf-74ee-44d9-b2c9-d728a30d9a09 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.314046] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.314233] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.314811] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.314811] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.314811] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.315950] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.315950] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.315950] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.315950] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('249b36cf-74ee-44d9-b2c9-d728a30d9a09',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.599080] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.599080] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.599080] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.599080] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.622781] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.623178] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.623349] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.623453] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.623714] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.623829] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.623948] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28940b1a-276d-41ed-a135-91ce1b6e2b2c is going to be updated. [ 991.655254] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.655484] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.655618] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.655885] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.656077] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.664395] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28940b1a-276d-41ed-a135-91ce1b6e2b2c in Status: IN_PROGRESS for 2s [ 991.811585] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 06037bb8-e014-4666-b9a5-57a1c338d994 [ 991.811826] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.811957] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.812036] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.812308] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.812426] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.812526] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:06037bb8-e014-4666-b9a5-57a1c338d994 already deleted. [ 991.812609] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06037bb8-e014-4666-b9a5-57a1c338d994" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.818804] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('249b36cf-74ee-44d9-b2c9-d728a30d9a09',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.843098] env[68328]: INFO networking_nsxv3.common.synchronization [req-829698d7-6bd6-44e9-8fdf-20e47007ff2e req-ea202144-0caa-473d-b111-2257472f8412 service nova] Enqueued Resource ID: 136bcfc4-bc92-46ea-9e01-01b9a11704ee with Priority: HIGHEST for action security_group_rules [ 991.843258] env[68328]: INFO networking_nsxv3.common.synchronization [req-829698d7-6bd6-44e9-8fdf-20e47007ff2e req-ea202144-0caa-473d-b111-2257472f8412 service nova] Enqueued Resource ID: 136bcfc4-bc92-46ea-9e01-01b9a11704ee with Priority: HIGHEST for action security_group_members [ 991.844233] env[68328]: INFO networking_nsxv3.common.synchronization [req-829698d7-6bd6-44e9-8fdf-20e47007ff2e req-ea202144-0caa-473d-b111-2257472f8412 service nova] Enqueued Resource ID: aba774fd-cc3c-42b2-bd1f-b612806350db with Priority: HIGHEST for action port [ 991.844295] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 136bcfc4-bc92-46ea-9e01-01b9a11704ee with Priority: HIGHEST for action security_group_rules [ 991.845383] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 136bcfc4-bc92-46ea-9e01-01b9a11704ee with Priority: HIGHEST for action security_group_members [ 991.845383] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aba774fd-cc3c-42b2-bd1f-b612806350db with Priority: HIGHEST for action port [ 991.845383] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-136bcfc4-bc92-46ea-9e01-01b9a11704ee taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.845383] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-136bcfc4-bc92-46ea-9e01-01b9a11704ee" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.845383] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-136bcfc4-bc92-46ea-9e01-01b9a11704ee" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.846599] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-136bcfc4-bc92-46ea-9e01-01b9a11704ee" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.846709] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('136bcfc4-bc92-46ea-9e01-01b9a11704ee',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.847574] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-136bcfc4-bc92-46ea-9e01-01b9a11704ee taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.847692] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-136bcfc4-bc92-46ea-9e01-01b9a11704ee" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.847749] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-136bcfc4-bc92-46ea-9e01-01b9a11704ee" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.847926] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-136bcfc4-bc92-46ea-9e01-01b9a11704ee" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.848087] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.848182] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.848236] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.848420] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.848509] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.848889] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('136bcfc4-bc92-46ea-9e01-01b9a11704ee',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.849380] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-aba774fd-cc3c-42b2-bd1f-b612806350db taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.849507] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aba774fd-cc3c-42b2-bd1f-b612806350db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.849576] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aba774fd-cc3c-42b2-bd1f-b612806350db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.849731] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aba774fd-cc3c-42b2-bd1f-b612806350db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.849810] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aba774fd-cc3c-42b2-bd1f-b612806350db',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.321641] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('249b36cf-74ee-44d9-b2c9-d728a30d9a09',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.353105] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-136bcfc4-bc92-46ea-9e01-01b9a11704ee taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.353249] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-136bcfc4-bc92-46ea-9e01-01b9a11704ee" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.353372] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('136bcfc4-bc92-46ea-9e01-01b9a11704ee',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.354305] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aba774fd-cc3c-42b2-bd1f-b612806350db with status ACTIVE [ 992.354510] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.354632] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.354696] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.354909] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.354994] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.355179] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.355273] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.355324] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.355810] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.355810] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.355810] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.355810] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.356058] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.356058] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.356140] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.356140] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aba774fd-cc3c-42b2-bd1f-b612806350db is going to be updated. [ 992.377731] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.377731] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.377731] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.377731] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.377731] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.377731] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aba774fd-cc3c-42b2-bd1f-b612806350db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.827977] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.828211] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.828284] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.828506] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.828599] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.828701] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 is going to be updated. [ 992.854176] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.854337] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.854397] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.854605] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.854762] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.858361] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('136bcfc4-bc92-46ea-9e01-01b9a11704ee',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.862475] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 in Status: IN_PROGRESS for 2s [ 993.332376] env[68328]: INFO networking_nsxv3.common.synchronization [None req-d4d4f1f1-d383-45f1-b7c0-5f6de662bd0a None None] Enqueued Resource ID: b9f23328-961f-4bc9-bd16-6b2d800b2276 with Priority: HIGHEST for action port [ 993.332675] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9f23328-961f-4bc9-bd16-6b2d800b2276 with Priority: HIGHEST for action port [ 993.333209] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9f23328-961f-4bc9-bd16-6b2d800b2276 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.333337] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9f23328-961f-4bc9-bd16-6b2d800b2276" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.333394] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9f23328-961f-4bc9-bd16-6b2d800b2276" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.333666] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9f23328-961f-4bc9-bd16-6b2d800b2276" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.333743] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9f23328-961f-4bc9-bd16-6b2d800b2276',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.361123] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.361309] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.361309] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.361552] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.362845] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.363029] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 136bcfc4-bc92-46ea-9e01-01b9a11704ee is going to be created. [ 993.387269] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.387447] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.387605] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.387695] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.387837] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.397084] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 136bcfc4-bc92-46ea-9e01-01b9a11704ee in Status: UNINITIALIZED for 2s [ 993.679304] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28940b1a-276d-41ed-a135-91ce1b6e2b2c in Status: SUCCESS [ 993.679304] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28940b1a-276d-41ed-a135-91ce1b6e2b2c deletion is rescheduled due to dependency. [ 993.679472] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.679844] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.679844] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.680249] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.680249] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.680249] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.680467] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.680467] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.680546] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.680661] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-28940b1a-276d-41ed-a135-91ce1b6e2b2c taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.680730] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.680789] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.680932] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.681083] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.681176] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.681236] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.681447] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.681519] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.681604] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.681687] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('28940b1a-276d-41ed-a135-91ce1b6e2b2c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.682565] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.682726] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.682873] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.682970] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.683042] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.683189] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.683265] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.683338] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28940b1a-276d-41ed-a135-91ce1b6e2b2c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.809952] env[68328]: INFO networking_nsxv3.common.synchronization [req-e1f87e44-0fe6-4dbb-a53e-85e2ab0ab09f req-8ed83178-d8f4-46ae-bbb4-cf749dea57dc tempest-DeleteServersTestJSON-1696259291 tempest-DeleteServersTestJSON-1696259291-project-member] Enqueued Resource ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 with Priority: HIGHEST for action security_group_members [ 993.810387] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 with Priority: HIGHEST for action security_group_members [ 993.810908] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.810908] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.810908] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.813826] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.813826] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.813826] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.813826] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.813826] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.813826] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.813826] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c35aa45-69e7-4952-b5d8-8a7d6b3460e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.838431] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b9f23328-961f-4bc9-bd16-6b2d800b2276 [ 993.838672] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.838798] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.838848] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.839397] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.839522] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.839784] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b9f23328-961f-4bc9-bd16-6b2d800b2276 already deleted. [ 993.839784] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9f23328-961f-4bc9-bd16-6b2d800b2276" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.992604] env[68328]: INFO networking_nsxv3.common.synchronization [req-2ef14517-34d9-4005-92bd-4cf7dfb3b050 req-cff56964-b10f-4406-b714-71fc0ea8ca4e tempest-ServerRescueNegativeTestJSON-1315865897 tempest-ServerRescueNegativeTestJSON-1315865897-project-member] Enqueued Resource ID: 9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a with Priority: HIGHEST for action security_group_members [ 993.993104] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a with Priority: HIGHEST for action security_group_members [ 993.993397] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.993512] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.993576] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.993823] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.993961] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.994121] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.994183] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.994352] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.994437] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.994524] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.189447] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.189661] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.189740] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.190045] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.190169] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.190533] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.190707] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.190865] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.191075] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.191162] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.191259] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28940b1a-276d-41ed-a135-91ce1b6e2b2c is going to be updated. [ 994.192801] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 28940b1a-276d-41ed-a135-91ce1b6e2b2c: rpc.has_security_group_logging(os_id): False [ 994.226721] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.226932] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.226932] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.227166] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.227258] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.227479] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.227581] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.227645] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.227804] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.227879] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.228081] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.228176] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.228237] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.228378] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.228462] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.228635] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.228746] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.228816] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.228978] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.229084] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.229181] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28940b1a-276d-41ed-a135-91ce1b6e2b2c is going to be updated. [ 994.232728] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.232864] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.232864] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.233017] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.233153] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.242246] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28940b1a-276d-41ed-a135-91ce1b6e2b2c in Status: IN_PROGRESS for 2s [ 994.296230] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.298019] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.298019] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.298019] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.298019] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.313455] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28940b1a-276d-41ed-a135-91ce1b6e2b2c in Status: IN_PROGRESS for 2s [ 994.317415] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.317415] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.317415] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.317415] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.340262] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.340593] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.340769] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.340886] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.341155] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.341246] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.341360] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 is going to be updated. [ 994.385517] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-682 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.385757] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-682" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.385906] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-682" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.386165] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-682" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.386425] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.386584] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.386708] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.386923] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.387408] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.387491] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 994.387614] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 994.387730] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 994.387842] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 994.387959] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 994.388100] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 994.388283] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 994.391697] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.391802] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.391867] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.392045] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.392183] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.402705] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 in Status: IN_PROGRESS for 2s [ 994.418452] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 994.418627] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 994.418771] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 994.418945] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-682" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.419355] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-c9a45738-b56d-4a30-92b8-f547795fa9a8 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.419543] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-c9a45738-b56d-4a30-92b8-f547795fa9a8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.419670] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-c9a45738-b56d-4a30-92b8-f547795fa9a8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.419984] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-c9a45738-b56d-4a30-92b8-f547795fa9a8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.420160] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9a45738-b56d-4a30-92b8-f547795fa9a8',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.496387] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.497015] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.497120] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.497342] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.497433] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.497632] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.497733] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.497790] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.497939] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.498028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.498115] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a already deleted. [ 994.498197] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.806123] env[68328]: INFO networking_nsxv3.common.synchronization [None req-090adfce-6f09-48a7-bc1c-63d33b51b9cc None None] Enqueued Resource ID: 39055a15-fca0-4c02-8e70-8de783d6b1dc with Priority: HIGHEST for action port [ 994.806123] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39055a15-fca0-4c02-8e70-8de783d6b1dc with Priority: HIGHEST for action port [ 994.807795] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-39055a15-fca0-4c02-8e70-8de783d6b1dc taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.808287] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39055a15-fca0-4c02-8e70-8de783d6b1dc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.808947] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39055a15-fca0-4c02-8e70-8de783d6b1dc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.808947] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39055a15-fca0-4c02-8e70-8de783d6b1dc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.808947] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39055a15-fca0-4c02-8e70-8de783d6b1dc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.874403] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 in Status: SUCCESS [ 994.874403] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.925135] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.925135] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.925135] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.925317] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.925468] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.925628] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port c9a45738-b56d-4a30-92b8-f547795fa9a8 not found, creating... [ 994.925894] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.926075] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.926199] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.926424] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.926568] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.926852] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.927933] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.927933] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.927933] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.927933] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.927933] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: c9a45738-b56d-4a30-92b8-f547795fa9a8 is going to be created. [ 994.949740] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.949740] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.949740] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.950187] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.950456] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.950725] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-c9a45738-b56d-4a30-92b8-f547795fa9a8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.312668] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 39055a15-fca0-4c02-8e70-8de783d6b1dc [ 995.312668] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.312668] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.312668] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.312668] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.312668] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.312668] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:39055a15-fca0-4c02-8e70-8de783d6b1dc already deleted. [ 995.312668] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39055a15-fca0-4c02-8e70-8de783d6b1dc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.407284] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 136bcfc4-bc92-46ea-9e01-01b9a11704ee in Status: SUCCESS [ 995.407592] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-136bcfc4-bc92-46ea-9e01-01b9a11704ee" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.407643] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-136bcfc4-bc92-46ea-9e01-01b9a11704ee" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.407872] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-136bcfc4-bc92-46ea-9e01-01b9a11704ee" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.409032] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.409032] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.409032] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.409032] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.409032] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.409032] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-136bcfc4-bc92-46ea-9e01-01b9a11704ee" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.409032] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('136bcfc4-bc92-46ea-9e01-01b9a11704ee',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.631141] env[68328]: INFO networking_nsxv3.common.synchronization [req-2ef14517-34d9-4005-92bd-4cf7dfb3b050 req-9ebfda33-080d-4e12-97b2-533f3a5e5890 service nova] Enqueued Resource ID: 9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a with Priority: HIGHEST for action security_group_rules [ 995.631141] env[68328]: INFO networking_nsxv3.common.synchronization [req-2ef14517-34d9-4005-92bd-4cf7dfb3b050 req-9ebfda33-080d-4e12-97b2-533f3a5e5890 service nova] Enqueued Resource ID: 9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a with Priority: HIGHEST for action security_group_members [ 995.631141] env[68328]: INFO networking_nsxv3.common.synchronization [req-2ef14517-34d9-4005-92bd-4cf7dfb3b050 req-9ebfda33-080d-4e12-97b2-533f3a5e5890 service nova] Enqueued Resource ID: c9a45738-b56d-4a30-92b8-f547795fa9a8 with Priority: HIGHEST for action port [ 995.631443] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a with Priority: HIGHEST for action security_group_rules [ 995.631627] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a with Priority: HIGHEST for action security_group_members [ 995.631766] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9a45738-b56d-4a30-92b8-f547795fa9a8 with Priority: HIGHEST for action port [ 995.632370] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.632568] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.632707] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.632942] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.633087] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.634896] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.634997] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.635073] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.635232] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.635373] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.635462] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.635521] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.635685] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.636265] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.636265] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.637613] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-c9a45738-b56d-4a30-92b8-f547795fa9a8 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.641167] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c9a45738-b56d-4a30-92b8-f547795fa9a8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.641242] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c9a45738-b56d-4a30-92b8-f547795fa9a8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.641436] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c9a45738-b56d-4a30-92b8-f547795fa9a8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.641517] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9a45738-b56d-4a30-92b8-f547795fa9a8',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.916401] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-136bcfc4-bc92-46ea-9e01-01b9a11704ee taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.916401] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-136bcfc4-bc92-46ea-9e01-01b9a11704ee" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.916401] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-136bcfc4-bc92-46ea-9e01-01b9a11704ee" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.916401] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-136bcfc4-bc92-46ea-9e01-01b9a11704ee" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.916401] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.916401] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.916401] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.916401] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.916401] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.916401] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-136bcfc4-bc92-46ea-9e01-01b9a11704ee" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.916401] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-136bcfc4-bc92-46ea-9e01-01b9a11704ee taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.916401] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-136bcfc4-bc92-46ea-9e01-01b9a11704ee" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.916401] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-136bcfc4-bc92-46ea-9e01-01b9a11704ee" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.916401] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-136bcfc4-bc92-46ea-9e01-01b9a11704ee" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.916401] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.916939] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.916939] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.916939] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.916939] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.916939] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-136bcfc4-bc92-46ea-9e01-01b9a11704ee" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.916939] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('136bcfc4-bc92-46ea-9e01-01b9a11704ee',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.106231] env[68328]: INFO networking_nsxv3.common.synchronization [req-a52673f7-025b-40fe-b5b3-71d2dfced2be req-23e4e461-6f14-4685-97b3-30bdadf15655 tempest-ImagesOneServerNegativeTestJSON-288072164 tempest-ImagesOneServerNegativeTestJSON-288072164-project-member] Enqueued Resource ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 with Priority: HIGHEST for action security_group_members [ 996.106740] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 with Priority: HIGHEST for action security_group_members [ 996.107063] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-55f209f1-d8fe-4d5e-a886-797753b1b3c1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.107188] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.107241] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.107446] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.107600] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.107696] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.107751] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.107942] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.108151] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.108151] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55f209f1-d8fe-4d5e-a886-797753b1b3c1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.146362] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.147338] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.147450] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.147612] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c9a45738-b56d-4a30-92b8-f547795fa9a8 with status ACTIVE [ 996.147766] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.147871] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.147934] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.148153] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.148237] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.148399] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.148544] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.148544] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.148697] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.148772] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.148945] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.149064] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.149098] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.149234] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.149313] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.149417] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c9a45738-b56d-4a30-92b8-f547795fa9a8 is going to be updated. [ 996.168742] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.168889] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.168959] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.169182] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.169340] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.169470] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c9a45738-b56d-4a30-92b8-f547795fa9a8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.252635] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28940b1a-276d-41ed-a135-91ce1b6e2b2c in Status: SUCCESS [ 996.252837] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28940b1a-276d-41ed-a135-91ce1b6e2b2c deletion is rescheduled due to dependency. [ 996.252954] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.328738] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28940b1a-276d-41ed-a135-91ce1b6e2b2c in Status: SUCCESS [ 996.329149] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.329470] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.329587] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.329742] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28940b1a-276d-41ed-a135-91ce1b6e2b2c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.410216] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-925 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.410592] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-925" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.410592] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-925" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.410824] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-925" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.411311] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.411551] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.411712] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.411973] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.412201] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.412426] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 996.412978] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 996.412978] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 996.412978] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 996.413146] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 996.413283] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 996.413451] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 996.415186] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 in Status: SUCCESS [ 996.415379] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 deletion is rescheduled due to dependency. [ 996.415579] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.420980] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 136bcfc4-bc92-46ea-9e01-01b9a11704ee: rpc.has_security_group_logging(os_id): False [ 996.442179] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 996.442388] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 996.442567] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 996.442755] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-925" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.443174] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-5114fe9d-dca9-435d-becc-412f4e210fe3 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.443359] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-5114fe9d-dca9-435d-becc-412f4e210fe3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.443493] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-5114fe9d-dca9-435d-becc-412f4e210fe3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.443862] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-5114fe9d-dca9-435d-becc-412f4e210fe3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.444212] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5114fe9d-dca9-435d-becc-412f4e210fe3',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.446302] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.446518] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.446642] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.446876] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.447038] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.447318] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.447622] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.447622] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.447805] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.448062] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.448262] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.448480] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.448657] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.448948] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.449290] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.449422] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.449578] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.449707] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.449901] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.450080] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.450246] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 136bcfc4-bc92-46ea-9e01-01b9a11704ee is going to be created. [ 996.508022] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.508022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.508022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.508022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.508022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.516293] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 136bcfc4-bc92-46ea-9e01-01b9a11704ee in Status: IN_PROGRESS for 2s [ 996.610622] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.610776] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.610847] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.611090] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.636877] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.637227] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.637353] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.640379] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.640379] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.640379] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.640379] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 is going to be updated. [ 996.652855] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.667447] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.667658] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.667658] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.667872] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.668018] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.677486] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 in Status: IN_PROGRESS for 2s [ 996.849171] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.849499] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.849589] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.849844] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.850027] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.850262] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28940b1a-276d-41ed-a135-91ce1b6e2b2c is going to be deleted. [ 996.897510] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.897510] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.897510] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.897510] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.897510] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.897510] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28940b1a-276d-41ed-a135-91ce1b6e2b2c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.956560] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.956560] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.956560] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.956560] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.956560] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.956871] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 5114fe9d-dca9-435d-becc-412f4e210fe3 not found, creating... [ 996.956966] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.957145] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.957269] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.957489] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.957631] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.957950] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.958169] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.958298] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.958656] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.958656] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.958805] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 5114fe9d-dca9-435d-becc-412f4e210fe3 is going to be created. [ 996.979622] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.980069] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.980069] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.980231] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.980486] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.980708] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-5114fe9d-dca9-435d-becc-412f4e210fe3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.157068] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.157237] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.157310] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.157519] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.157609] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.157704] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a is going to be created. [ 997.187605] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.187742] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.187810] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.188029] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.188303] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.197934] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a in Status: UNINITIALIZED for 2s [ 997.345761] env[68328]: INFO networking_nsxv3.common.synchronization [None req-114ac1d9-a387-4d84-8569-d6d3f0b139c6 None None] Enqueued Resource ID: 5fb26422-1150-45b4-b8d6-18885af0d55d with Priority: HIGHEST for action port [ 997.346340] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fb26422-1150-45b4-b8d6-18885af0d55d with Priority: HIGHEST for action port [ 997.347417] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-5fb26422-1150-45b4-b8d6-18885af0d55d taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.347417] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5fb26422-1150-45b4-b8d6-18885af0d55d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.347417] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5fb26422-1150-45b4-b8d6-18885af0d55d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.350052] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5fb26422-1150-45b4-b8d6-18885af0d55d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.350178] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5fb26422-1150-45b4-b8d6-18885af0d55d',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.657799] env[68328]: INFO networking_nsxv3.common.synchronization [req-a52673f7-025b-40fe-b5b3-71d2dfced2be req-8d825134-dd98-4075-a626-b52a34c2da41 service nova] Enqueued Resource ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 with Priority: HIGHEST for action security_group_rules [ 997.657799] env[68328]: INFO networking_nsxv3.common.synchronization [req-a52673f7-025b-40fe-b5b3-71d2dfced2be req-8d825134-dd98-4075-a626-b52a34c2da41 service nova] Enqueued Resource ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 with Priority: HIGHEST for action security_group_members [ 997.657799] env[68328]: INFO networking_nsxv3.common.synchronization [req-a52673f7-025b-40fe-b5b3-71d2dfced2be req-8d825134-dd98-4075-a626-b52a34c2da41 service nova] Enqueued Resource ID: 5114fe9d-dca9-435d-becc-412f4e210fe3 with Priority: HIGHEST for action port [ 997.657799] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 with Priority: HIGHEST for action security_group_rules [ 997.657799] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 with Priority: HIGHEST for action security_group_members [ 997.657799] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5114fe9d-dca9-435d-becc-412f4e210fe3 with Priority: HIGHEST for action port [ 997.658361] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55f209f1-d8fe-4d5e-a886-797753b1b3c1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.658361] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.658361] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.658361] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.658722] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55f209f1-d8fe-4d5e-a886-797753b1b3c1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.659433] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-55f209f1-d8fe-4d5e-a886-797753b1b3c1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.659536] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.659955] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-5114fe9d-dca9-435d-becc-412f4e210fe3 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.659955] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5114fe9d-dca9-435d-becc-412f4e210fe3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.659955] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5114fe9d-dca9-435d-becc-412f4e210fe3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.660186] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5114fe9d-dca9-435d-becc-412f4e210fe3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.660186] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5114fe9d-dca9-435d-becc-412f4e210fe3',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.853751] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5fb26422-1150-45b4-b8d6-18885af0d55d [ 997.853751] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.853751] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.853751] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.853751] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.853751] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.854213] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5fb26422-1150-45b4-b8d6-18885af0d55d already deleted. [ 997.854213] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5fb26422-1150-45b4-b8d6-18885af0d55d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.162261] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-55f209f1-d8fe-4d5e-a886-797753b1b3c1 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.162413] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.162621] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5114fe9d-dca9-435d-becc-412f4e210fe3 with status ACTIVE [ 998.162882] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.162949] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.162984] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.163188] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.163401] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.163493] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.163595] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.163654] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.163836] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.163915] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.164111] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.164204] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.164264] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.164403] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.164495] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.164594] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5114fe9d-dca9-435d-becc-412f4e210fe3 is going to be updated. [ 998.187402] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.187585] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.187637] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.187835] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.187970] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.188146] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5114fe9d-dca9-435d-becc-412f4e210fe3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.528106] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 136bcfc4-bc92-46ea-9e01-01b9a11704ee in Status: SUCCESS [ 998.528340] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-136bcfc4-bc92-46ea-9e01-01b9a11704ee" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.687351] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 in Status: SUCCESS [ 998.687711] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 deletion is rescheduled due to dependency. [ 998.687711] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.687780] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.687966] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.688168] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.688283] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.688353] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.688519] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.688602] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.688700] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55f209f1-d8fe-4d5e-a886-797753b1b3c1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.191604] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55f209f1-d8fe-4d5e-a886-797753b1b3c1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.208714] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a in Status: SUCCESS [ 999.208714] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.208714] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.208714] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.208982] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.208982] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.208982] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.209103] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.209196] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.209234] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.209491] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.693458] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55f209f1-d8fe-4d5e-a886-797753b1b3c1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.711106] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.197969] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.198159] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.198231] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.198463] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.198558] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.198657] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 is going to be updated. [ 1000.213346] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a: rpc.has_security_group_logging(os_id): False [ 1000.226150] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.226321] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.226360] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.226555] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.226700] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.231575] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.231723] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.231767] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.231934] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.232031] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.232266] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.232362] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.232417] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.232564] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.232657] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.232744] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a is going to be created. [ 1000.235228] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 in Status: IN_PROGRESS for 2s [ 1000.288214] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.288420] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.288466] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.288663] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.288846] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.298713] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a in Status: IN_PROGRESS for 2s [ 1001.130038] env[68328]: INFO networking_nsxv3.common.synchronization [None req-53ab616d-f382-4c09-a924-f940b5a67d14 None None] Enqueued Resource ID: 067146f7-4dbf-470a-b303-d7b7367f45c8 with Priority: HIGHEST for action port [ 1001.130038] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 067146f7-4dbf-470a-b303-d7b7367f45c8 with Priority: HIGHEST for action port [ 1001.130422] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-067146f7-4dbf-470a-b303-d7b7367f45c8 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.130422] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-067146f7-4dbf-470a-b303-d7b7367f45c8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.130499] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-067146f7-4dbf-470a-b303-d7b7367f45c8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.131289] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-067146f7-4dbf-470a-b303-d7b7367f45c8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.131289] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('067146f7-4dbf-470a-b303-d7b7367f45c8',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.635863] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 067146f7-4dbf-470a-b303-d7b7367f45c8 [ 1001.635863] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.635863] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.635863] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.635863] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.635863] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.635863] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:067146f7-4dbf-470a-b303-d7b7367f45c8 already deleted. [ 1001.635863] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-067146f7-4dbf-470a-b303-d7b7367f45c8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.243914] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 in Status: SUCCESS [ 1002.244681] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.246739] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.246739] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.246739] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.246739] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.246739] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.246739] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.246739] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.246739] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.246739] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('55f209f1-d8fe-4d5e-a886-797753b1b3c1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.308416] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a in Status: SUCCESS [ 1002.308416] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.748824] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-55f209f1-d8fe-4d5e-a886-797753b1b3c1 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.749033] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.749114] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.749366] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.749614] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.749716] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.749781] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.749946] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.750064] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.750199] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.750372] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-55f209f1-d8fe-4d5e-a886-797753b1b3c1 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.750494] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.750494] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.750756] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.750906] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.752222] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.752222] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.752222] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.752222] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.752222] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.752222] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('55f209f1-d8fe-4d5e-a886-797753b1b3c1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.254730] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 55f209f1-d8fe-4d5e-a886-797753b1b3c1: rpc.has_security_group_logging(os_id): False [ 1003.273248] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.273395] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.273469] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.273727] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.273844] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.274643] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.274643] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.274643] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.274643] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.274643] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.274975] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.274975] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.274975] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.275174] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.275174] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.275314] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.275411] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.275556] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.275713] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.275779] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.275831] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 is going to be updated. [ 1003.334235] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.334235] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.334235] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.334235] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.334494] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.355332] env[68328]: INFO networking_nsxv3.common.synchronization [None req-3152c413-cefe-4c14-8b8d-f328a67e1320 None None] Enqueued Resource ID: 8d010c52-30c4-4f23-8cb5-debfac37326d with Priority: HIGHEST for action port [ 1003.355605] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d010c52-30c4-4f23-8cb5-debfac37326d with Priority: HIGHEST for action port [ 1003.356340] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d010c52-30c4-4f23-8cb5-debfac37326d taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.356490] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d010c52-30c4-4f23-8cb5-debfac37326d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.356544] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d010c52-30c4-4f23-8cb5-debfac37326d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.356844] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d010c52-30c4-4f23-8cb5-debfac37326d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.356928] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d010c52-30c4-4f23-8cb5-debfac37326d',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.359127] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 in Status: IN_PROGRESS for 2s [ 1003.859928] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8d010c52-30c4-4f23-8cb5-debfac37326d [ 1003.860208] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.860345] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.860412] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.861037] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.861037] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.861037] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8d010c52-30c4-4f23-8cb5-debfac37326d already deleted. [ 1003.861037] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d010c52-30c4-4f23-8cb5-debfac37326d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.169470] env[68328]: INFO networking_nsxv3.common.synchronization [req-3058d5e4-cf81-4dfb-abcc-23685d83f9bd req-a096a812-7705-4802-8fac-ece5b68fad7f tempest-ServerMetadataNegativeTestJSON-1733751753 tempest-ServerMetadataNegativeTestJSON-1733751753-project-member] Enqueued Resource ID: 136bcfc4-bc92-46ea-9e01-01b9a11704ee with Priority: HIGHEST for action security_group_members [ 1004.170720] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 136bcfc4-bc92-46ea-9e01-01b9a11704ee with Priority: HIGHEST for action security_group_members [ 1004.170720] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-136bcfc4-bc92-46ea-9e01-01b9a11704ee taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.170720] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-136bcfc4-bc92-46ea-9e01-01b9a11704ee" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.170720] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-136bcfc4-bc92-46ea-9e01-01b9a11704ee" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.170933] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-136bcfc4-bc92-46ea-9e01-01b9a11704ee" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.174886] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.174886] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.174886] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.174886] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.174886] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.174886] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('136bcfc4-bc92-46ea-9e01-01b9a11704ee',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.597501] env[68328]: INFO networking_nsxv3.common.synchronization [req-8f9715b7-641a-4fdc-a66e-ff097c371828 req-7f306363-a2ed-4171-a86c-a869fc4152f5 tempest-ListServerFiltersTestJSON-1110536152 tempest-ListServerFiltersTestJSON-1110536152-project-member] Enqueued Resource ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f with Priority: HIGHEST for action security_group_members [ 1004.599702] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f with Priority: HIGHEST for action security_group_members [ 1004.600167] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.602466] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.602587] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.602835] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.603008] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.603117] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.603181] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.603329] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.603415] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.603509] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5812c2b-73e7-421d-b4bb-29c4ef848f3f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.680983] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.680983] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.680983] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.680983] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.680983] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.680983] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.680983] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.680983] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.680983] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.680983] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.680983] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 136bcfc4-bc92-46ea-9e01-01b9a11704ee is going to be updated. [ 1004.707789] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.707789] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.707789] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.707789] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.707789] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.714567] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 136bcfc4-bc92-46ea-9e01-01b9a11704ee in Status: IN_PROGRESS for 2s [ 1005.106348] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b5812c2b-73e7-421d-b4bb-29c4ef848f3f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.362543] env[68328]: INFO networking_nsxv3.common.synchronization [None req-5579c4a9-594f-4039-a74d-d3e7ec90d394 None None] Enqueued Resource ID: e9c472f3-2ac4-40c4-874c-96108faf33bd with Priority: HIGHEST for action port [ 1005.363078] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9c472f3-2ac4-40c4-874c-96108faf33bd with Priority: HIGHEST for action port [ 1005.363769] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9c472f3-2ac4-40c4-874c-96108faf33bd taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.363989] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9c472f3-2ac4-40c4-874c-96108faf33bd" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.363989] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9c472f3-2ac4-40c4-874c-96108faf33bd" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.364201] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9c472f3-2ac4-40c4-874c-96108faf33bd" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.364584] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9c472f3-2ac4-40c4-874c-96108faf33bd',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.377084] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 in Status: SUCCESS [ 1005.377084] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.610134] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b5812c2b-73e7-421d-b4bb-29c4ef848f3f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.866650] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e9c472f3-2ac4-40c4-874c-96108faf33bd [ 1005.866650] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.866753] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.866802] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.867015] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.867113] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.868036] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e9c472f3-2ac4-40c4-874c-96108faf33bd already deleted. [ 1005.868036] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9c472f3-2ac4-40c4-874c-96108faf33bd" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.114587] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.114797] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.115018] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.115128] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.115324] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.115324] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f is going to be updated. [ 1006.141606] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.141928] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.141928] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.145023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.145023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.153059] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f in Status: IN_PROGRESS for 2s [ 1006.728938] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 136bcfc4-bc92-46ea-9e01-01b9a11704ee in Status: SUCCESS [ 1006.728938] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 136bcfc4-bc92-46ea-9e01-01b9a11704ee deletion is rescheduled due to dependency. [ 1006.728938] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-136bcfc4-bc92-46ea-9e01-01b9a11704ee" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.112150] env[68328]: INFO networking_nsxv3.common.synchronization [None req-56d793d4-0105-49aa-a4c6-a4ab8d66fbf7 None None] Enqueued Resource ID: 5e023473-d4c6-4808-a131-114fbebb9bed with Priority: HIGHEST for action port [ 1007.112411] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e023473-d4c6-4808-a131-114fbebb9bed with Priority: HIGHEST for action port [ 1007.112973] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e023473-d4c6-4808-a131-114fbebb9bed taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.113117] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e023473-d4c6-4808-a131-114fbebb9bed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.113177] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e023473-d4c6-4808-a131-114fbebb9bed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.113427] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e023473-d4c6-4808-a131-114fbebb9bed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.113507] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e023473-d4c6-4808-a131-114fbebb9bed',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.616499] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5e023473-d4c6-4808-a131-114fbebb9bed [ 1007.616732] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.616865] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.616931] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.617190] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.617438] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.617438] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5e023473-d4c6-4808-a131-114fbebb9bed already deleted. [ 1007.617502] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e023473-d4c6-4808-a131-114fbebb9bed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.967978] env[68328]: INFO networking_nsxv3.common.synchronization [None req-20abdfbe-0445-4b20-8b39-e2a1aef085ac None None] Enqueued Resource ID: c8b32df1-5380-4bc7-a9e4-1496051accd5 with Priority: HIGHEST for action port [ 1007.968619] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8b32df1-5380-4bc7-a9e4-1496051accd5 with Priority: HIGHEST for action port [ 1007.968941] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-c8b32df1-5380-4bc7-a9e4-1496051accd5 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.969079] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c8b32df1-5380-4bc7-a9e4-1496051accd5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.969173] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c8b32df1-5380-4bc7-a9e4-1496051accd5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.969462] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c8b32df1-5380-4bc7-a9e4-1496051accd5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.969567] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8b32df1-5380-4bc7-a9e4-1496051accd5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.165705] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f in Status: SUCCESS [ 1008.165705] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.262442] env[68328]: INFO networking_nsxv3.common.synchronization [req-af87c15c-00f4-4c9d-9a66-37c6173b0730 req-a3c41c39-50a7-4d12-b8f3-c5a4975b4048 tempest-ImagesOneServerNegativeTestJSON-288072164 tempest-ImagesOneServerNegativeTestJSON-288072164-project-member] Enqueued Resource ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 with Priority: HIGHEST for action security_group_members [ 1008.262994] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 with Priority: HIGHEST for action security_group_members [ 1008.263327] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-55f209f1-d8fe-4d5e-a886-797753b1b3c1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.263450] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.263523] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.263866] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.263990] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.263990] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.264148] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.264228] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.264297] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.264718] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55f209f1-d8fe-4d5e-a886-797753b1b3c1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.474085] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c8b32df1-5380-4bc7-a9e4-1496051accd5 [ 1008.474365] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.474501] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.474573] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.474791] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.474882] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.474976] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c8b32df1-5380-4bc7-a9e4-1496051accd5 already deleted. [ 1008.475069] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c8b32df1-5380-4bc7-a9e4-1496051accd5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.767219] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.767376] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.767444] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.769533] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.769533] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.769533] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.769533] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.769533] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.769533] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.769533] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.770802] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 is going to be updated. [ 1008.799768] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.803268] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.803268] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.803268] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.803268] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.811028] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 in Status: IN_PROGRESS for 2s [ 1009.619023] env[68328]: INFO networking_nsxv3.common.synchronization [None req-6270809d-24ef-4f6f-99ce-791a45e25127 None None] Enqueued Resource ID: 6470ac57-263c-48a0-a18d-964d6feca53f with Priority: HIGHEST for action port [ 1009.619536] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6470ac57-263c-48a0-a18d-964d6feca53f with Priority: HIGHEST for action port [ 1009.622877] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-6470ac57-263c-48a0-a18d-964d6feca53f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.623030] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6470ac57-263c-48a0-a18d-964d6feca53f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.623107] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6470ac57-263c-48a0-a18d-964d6feca53f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.623368] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6470ac57-263c-48a0-a18d-964d6feca53f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.623456] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6470ac57-263c-48a0-a18d-964d6feca53f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.127860] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6470ac57-263c-48a0-a18d-964d6feca53f [ 1010.128108] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.128246] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.128311] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.128588] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.128679] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.128710] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6470ac57-263c-48a0-a18d-964d6feca53f already deleted. [ 1010.128771] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6470ac57-263c-48a0-a18d-964d6feca53f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.822188] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 in Status: SUCCESS [ 1010.822479] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 deletion is rescheduled due to dependency. [ 1010.822479] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.279134] env[68328]: INFO networking_nsxv3.common.synchronization [req-3753273f-3c16-4d4d-9476-864f4a8b558f req-4b0b6c2f-10c3-4b4e-bc49-94ec751fedf2 tempest-ServerRescueTestJSON-1284245856 tempest-ServerRescueTestJSON-1284245856-project-member] Enqueued Resource ID: fdf99f09-b7da-4a5c-af72-042c6f58dc8e with Priority: HIGHEST for action security_group_members [ 1013.279790] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdf99f09-b7da-4a5c-af72-042c6f58dc8e with Priority: HIGHEST for action security_group_members [ 1013.280159] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.280315] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.280415] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.280658] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.280849] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.280981] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.281088] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.281203] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.281326] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.281432] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fdf99f09-b7da-4a5c-af72-042c6f58dc8e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.559693] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-289 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.559910] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-289" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.560055] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-289" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.560385] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-289" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.560665] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.560832] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.561173] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.561939] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.562363] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.562459] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1013.562654] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1013.562858] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1013.563040] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1013.563400] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1013.563400] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1013.563529] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1013.583644] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1013.583828] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1013.583981] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1013.584182] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-289" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.584505] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-14e3a4c6-65e2-4469-96c9-969f9344c07e taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.584681] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-14e3a4c6-65e2-4469-96c9-969f9344c07e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.584805] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-14e3a4c6-65e2-4469-96c9-969f9344c07e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.585154] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-14e3a4c6-65e2-4469-96c9-969f9344c07e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.585294] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14e3a4c6-65e2-4469-96c9-969f9344c07e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.758925] env[68328]: INFO networking_nsxv3.common.synchronization [req-8797e3bc-7ff8-4458-827b-a932bdf543d1 req-b23743f7-7762-40a9-9ea8-36a8ce7547bf tempest-ImagesTestJSON-69996350 tempest-ImagesTestJSON-69996350-project-member] Enqueued Resource ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 with Priority: HIGHEST for action security_group_members [ 1013.759443] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 with Priority: HIGHEST for action security_group_members [ 1013.759760] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-249b36cf-74ee-44d9-b2c9-d728a30d9a09 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.759959] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.760051] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.760249] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.760430] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.760508] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.760508] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.760672] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.760768] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.760847] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('249b36cf-74ee-44d9-b2c9-d728a30d9a09',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.783420] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.783869] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.783869] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.783992] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.784137] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.784610] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.784610] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.784610] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.784742] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.784868] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.784928] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdf99f09-b7da-4a5c-af72-042c6f58dc8e already deleted. [ 1013.785043] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.087404] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.087650] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.087788] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.088134] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.088306] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.088501] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 14e3a4c6-65e2-4469-96c9-969f9344c07e not found, creating... [ 1014.088778] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.088938] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.089093] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.089310] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.089453] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.090033] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.090033] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.090228] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.090286] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.090429] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.090576] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 14e3a4c6-65e2-4469-96c9-969f9344c07e is going to be created. [ 1014.111068] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.111287] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.111426] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.111820] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.112046] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.112334] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-14e3a4c6-65e2-4469-96c9-969f9344c07e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.263857] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.263857] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.263857] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.264067] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.286811] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.286811] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.287156] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.287156] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.287156] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.287249] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.287383] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 is going to be updated. [ 1014.320045] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.320233] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.320396] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.320471] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.320608] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.328925] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 in Status: IN_PROGRESS for 2s [ 1014.908025] env[68328]: INFO networking_nsxv3.common.synchronization [req-b23c9586-b563-4da1-96d4-cdffac613b68 req-babdeb44-ea50-43a1-949c-73c4c3f683bb tempest-ServersWithSpecificFlavorTestJSON-2033217338 tempest-ServersWithSpecificFlavorTestJSON-2033217338-project-member] Enqueued Resource ID: 3e399462-679e-43d6-8b03-2876938fc726 with Priority: HIGHEST for action security_group_members [ 1014.908025] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e399462-679e-43d6-8b03-2876938fc726 with Priority: HIGHEST for action security_group_members [ 1014.908025] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e399462-679e-43d6-8b03-2876938fc726 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.908025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.908025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.908853] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.909239] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.909529] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.910361] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.910730] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.910985] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.911270] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e399462-679e-43d6-8b03-2876938fc726',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.991250] env[68328]: INFO networking_nsxv3.common.synchronization [req-3753273f-3c16-4d4d-9476-864f4a8b558f req-1abc53c0-3b34-4ffd-b344-3522c18ebb64 service nova] Enqueued Resource ID: fdf99f09-b7da-4a5c-af72-042c6f58dc8e with Priority: HIGHEST for action security_group_rules [ 1014.991420] env[68328]: INFO networking_nsxv3.common.synchronization [req-3753273f-3c16-4d4d-9476-864f4a8b558f req-1abc53c0-3b34-4ffd-b344-3522c18ebb64 service nova] Enqueued Resource ID: fdf99f09-b7da-4a5c-af72-042c6f58dc8e with Priority: HIGHEST for action security_group_members [ 1014.991562] env[68328]: INFO networking_nsxv3.common.synchronization [req-3753273f-3c16-4d4d-9476-864f4a8b558f req-1abc53c0-3b34-4ffd-b344-3522c18ebb64 service nova] Enqueued Resource ID: 14e3a4c6-65e2-4469-96c9-969f9344c07e with Priority: HIGHEST for action port [ 1014.992092] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdf99f09-b7da-4a5c-af72-042c6f58dc8e with Priority: HIGHEST for action security_group_rules [ 1014.992594] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdf99f09-b7da-4a5c-af72-042c6f58dc8e with Priority: HIGHEST for action security_group_members [ 1014.992594] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14e3a4c6-65e2-4469-96c9-969f9344c07e with Priority: HIGHEST for action port [ 1014.992594] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fdf99f09-b7da-4a5c-af72-042c6f58dc8e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.992849] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.992849] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.993111] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.993166] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fdf99f09-b7da-4a5c-af72-042c6f58dc8e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.994111] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.994238] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.994298] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.994452] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.996626] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.996626] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.996626] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.996626] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.996626] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.996626] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fdf99f09-b7da-4a5c-af72-042c6f58dc8e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.996626] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-14e3a4c6-65e2-4469-96c9-969f9344c07e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.996626] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14e3a4c6-65e2-4469-96c9-969f9344c07e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.996626] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14e3a4c6-65e2-4469-96c9-969f9344c07e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.996626] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14e3a4c6-65e2-4469-96c9-969f9344c07e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.996626] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14e3a4c6-65e2-4469-96c9-969f9344c07e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.339149] env[68328]: INFO networking_nsxv3.common.synchronization [req-68ac3b52-c053-43e9-9c8c-2c98d181b146 req-148e7afa-63f9-484f-b7f9-929135915b57 tempest-AttachInterfacesTestJSON-966841523 tempest-AttachInterfacesTestJSON-966841523-project-member] Enqueued Resource ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 with Priority: HIGHEST for action security_group_members [ 1015.339149] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 with Priority: HIGHEST for action security_group_members [ 1015.339149] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.339149] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.339149] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.339149] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.339149] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.339149] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.339149] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.340148] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.340390] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.340598] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('398e93bc-b7ea-4684-aa02-2e6ab22c1fe5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.414170] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.414320] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.414395] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.414618] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.450461] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.450729] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.450815] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.451040] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.451119] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.451161] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.451247] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e399462-679e-43d6-8b03-2876938fc726 is going to be updated. [ 1015.493166] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.493322] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.493381] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.493574] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.493728] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.498381] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.500209] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.500209] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fdf99f09-b7da-4a5c-af72-042c6f58dc8e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.500209] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 14e3a4c6-65e2-4469-96c9-969f9344c07e with status ACTIVE [ 1015.500209] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.500209] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.500209] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.500858] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.500858] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.500858] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.500858] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.500858] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.500858] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.501447] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.502014] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.502014] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.502014] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.502171] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.502273] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.502314] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 14e3a4c6-65e2-4469-96c9-969f9344c07e is going to be updated. [ 1015.506043] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e399462-679e-43d6-8b03-2876938fc726 in Status: IN_PROGRESS for 2s [ 1015.543633] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.543835] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.543960] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.544253] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.544414] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.544586] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14e3a4c6-65e2-4469-96c9-969f9344c07e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.651784] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-615 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.651984] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-615" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.652221] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-615" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.652561] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-615" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.652923] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.653034] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.653333] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.653410] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.654208] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.654442] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1015.654516] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1015.654634] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1015.654788] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1015.654956] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1015.655585] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1015.655585] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1015.680810] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1015.681064] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1015.681193] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1015.681565] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-615" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.681793] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-24eb86e0-0600-4098-82cb-3dd819b72112 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.681943] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-24eb86e0-0600-4098-82cb-3dd819b72112" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.682636] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-24eb86e0-0600-4098-82cb-3dd819b72112" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.682636] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-24eb86e0-0600-4098-82cb-3dd819b72112" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.682636] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24eb86e0-0600-4098-82cb-3dd819b72112',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.842972] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.843136] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.843216] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.843426] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.863372] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.863722] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.863909] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.863993] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.864208] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.864293] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.864386] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 is going to be updated. [ 1015.885604] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.885712] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.885775] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.885986] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.886136] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.893964] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 in Status: IN_PROGRESS for 2s [ 1016.005564] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fdf99f09-b7da-4a5c-af72-042c6f58dc8e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.187134] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.187134] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.187134] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.187306] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.187412] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.187568] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 24eb86e0-0600-4098-82cb-3dd819b72112 not found, creating... [ 1016.187894] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.188085] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.188209] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.188447] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.188646] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.189094] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.190032] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.190032] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.190032] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.190032] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.190227] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 24eb86e0-0600-4098-82cb-3dd819b72112 is going to be created. [ 1016.233223] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.233431] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.233566] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.233844] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.234167] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.234405] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-24eb86e0-0600-4098-82cb-3dd819b72112" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.339260] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 in Status: SUCCESS [ 1016.339481] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 deletion is rescheduled due to dependency. [ 1016.339519] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.508132] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.508298] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.508371] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.508592] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.508681] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.508781] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdf99f09-b7da-4a5c-af72-042c6f58dc8e is going to be created. [ 1016.531854] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.531996] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.532102] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.532309] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.532473] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.541869] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdf99f09-b7da-4a5c-af72-042c6f58dc8e in Status: UNINITIALIZED for 2s [ 1016.919444] env[68328]: INFO networking_nsxv3.common.synchronization [req-68ac3b52-c053-43e9-9c8c-2c98d181b146 req-aec5e1e9-95e3-4b39-a8a4-7e18ee475710 service nova] Enqueued Resource ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 with Priority: HIGHEST for action security_group_rules [ 1016.919645] env[68328]: INFO networking_nsxv3.common.synchronization [req-68ac3b52-c053-43e9-9c8c-2c98d181b146 req-aec5e1e9-95e3-4b39-a8a4-7e18ee475710 service nova] Enqueued Resource ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 with Priority: HIGHEST for action security_group_members [ 1016.919800] env[68328]: INFO networking_nsxv3.common.synchronization [req-68ac3b52-c053-43e9-9c8c-2c98d181b146 req-aec5e1e9-95e3-4b39-a8a4-7e18ee475710 service nova] Enqueued Resource ID: 24eb86e0-0600-4098-82cb-3dd819b72112 with Priority: HIGHEST for action port [ 1016.920360] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 with Priority: HIGHEST for action security_group_rules [ 1016.920508] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 with Priority: HIGHEST for action security_group_members [ 1016.920624] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24eb86e0-0600-4098-82cb-3dd819b72112 with Priority: HIGHEST for action port [ 1016.920984] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.922192] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.922280] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.922502] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.922591] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('398e93bc-b7ea-4684-aa02-2e6ab22c1fe5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.924368] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.925235] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.925235] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-24eb86e0-0600-4098-82cb-3dd819b72112 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.925235] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-24eb86e0-0600-4098-82cb-3dd819b72112" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.925235] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-24eb86e0-0600-4098-82cb-3dd819b72112" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.925575] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-24eb86e0-0600-4098-82cb-3dd819b72112" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.925575] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24eb86e0-0600-4098-82cb-3dd819b72112',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.428494] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.428815] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.428815] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 24eb86e0-0600-4098-82cb-3dd819b72112 with status ACTIVE [ 1017.428975] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.429101] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.429166] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.429392] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.429495] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.429788] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.429788] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.429904] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.430017] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.430071] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.430301] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.430410] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.430410] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.430514] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.430579] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.431505] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 24eb86e0-0600-4098-82cb-3dd819b72112 is going to be updated. [ 1017.451911] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.452070] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.452140] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.452345] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.453661] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.453661] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-24eb86e0-0600-4098-82cb-3dd819b72112" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.524948] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e399462-679e-43d6-8b03-2876938fc726 in Status: SUCCESS [ 1017.525170] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e399462-679e-43d6-8b03-2876938fc726 deletion is rescheduled due to dependency. [ 1017.525286] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.634025] env[68328]: INFO networking_nsxv3.common.synchronization [req-aec503f8-cf67-4f88-9b4f-1679bb6db923 req-7ea2afba-5aac-4bc8-b177-c316f0319db9 tempest-ServerDiskConfigTestJSON-155339900 tempest-ServerDiskConfigTestJSON-155339900-project-member] Enqueued Resource ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 with Priority: HIGHEST for action security_group_members [ 1017.634025] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 with Priority: HIGHEST for action security_group_members [ 1017.634025] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-261361c9-81c8-47fa-9a8a-4e37a8a439d7 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.634025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.634025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.634617] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.634889] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.636339] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.636339] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.636339] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.636339] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.636339] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('261361c9-81c8-47fa-9a8a-4e37a8a439d7',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.906925] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 in Status: SUCCESS [ 1017.907147] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 deletion is rescheduled due to dependency. [ 1017.907318] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.907858] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.908261] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.908261] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.908459] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.908459] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.908615] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.908702] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.908831] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('398e93bc-b7ea-4684-aa02-2e6ab22c1fe5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.025445] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-754 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.026181] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-754" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.026181] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-754" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.026181] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-754" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.026765] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.026870] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.026958] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.027207] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.027359] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.027585] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1018.027702] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1018.027811] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1018.028110] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1018.028110] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1018.028209] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1018.028315] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1018.046060] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1018.046264] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1018.046410] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1018.046630] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-754" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.046969] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-908fc422-2790-4112-bef9-4b29d1594168 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.047155] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-908fc422-2790-4112-bef9-4b29d1594168" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.047296] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-908fc422-2790-4112-bef9-4b29d1594168" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.047621] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-908fc422-2790-4112-bef9-4b29d1594168" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.047783] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('908fc422-2790-4112-bef9-4b29d1594168',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.138267] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.138447] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.138519] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.138729] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.138817] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.139012] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.139113] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.139176] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.139325] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.139467] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.139628] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 already deleted. [ 1018.139749] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.412226] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('398e93bc-b7ea-4684-aa02-2e6ab22c1fe5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.552164] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.552164] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.552164] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.552164] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.552164] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.552164] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 908fc422-2790-4112-bef9-4b29d1594168 not found, creating... [ 1018.552865] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.552865] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.552865] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.553055] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.553102] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.553371] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.553536] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.553657] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.553879] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.554068] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.554210] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 908fc422-2790-4112-bef9-4b29d1594168 is going to be created. [ 1018.555797] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdf99f09-b7da-4a5c-af72-042c6f58dc8e in Status: SUCCESS [ 1018.555986] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.556748] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.556860] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.556993] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.557104] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.557166] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.557305] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.557381] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.557462] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.557548] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fdf99f09-b7da-4a5c-af72-042c6f58dc8e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.584725] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.584937] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.585090] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.585444] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.585686] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.585922] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-908fc422-2790-4112-bef9-4b29d1594168" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.914411] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('398e93bc-b7ea-4684-aa02-2e6ab22c1fe5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.059755] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.059890] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.059939] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.060172] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.060350] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.060453] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.060519] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.060667] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.060754] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.060841] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.060981] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.061084] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.061215] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.061273] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.061404] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.061539] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.061644] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.061872] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.061998] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.062144] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.062270] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fdf99f09-b7da-4a5c-af72-042c6f58dc8e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.269124] env[68328]: INFO networking_nsxv3.common.synchronization [req-aec503f8-cf67-4f88-9b4f-1679bb6db923 req-8669eadf-5780-4a6b-ab5a-e1ed3fe0803f service nova] Enqueued Resource ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 with Priority: HIGHEST for action security_group_rules [ 1019.269447] env[68328]: INFO networking_nsxv3.common.synchronization [req-aec503f8-cf67-4f88-9b4f-1679bb6db923 req-8669eadf-5780-4a6b-ab5a-e1ed3fe0803f service nova] Enqueued Resource ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 with Priority: HIGHEST for action security_group_members [ 1019.270038] env[68328]: INFO networking_nsxv3.common.synchronization [req-aec503f8-cf67-4f88-9b4f-1679bb6db923 req-8669eadf-5780-4a6b-ab5a-e1ed3fe0803f service nova] Enqueued Resource ID: 908fc422-2790-4112-bef9-4b29d1594168 with Priority: HIGHEST for action port [ 1019.270841] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 with Priority: HIGHEST for action security_group_rules [ 1019.270841] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 with Priority: HIGHEST for action security_group_members [ 1019.270841] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 908fc422-2790-4112-bef9-4b29d1594168 with Priority: HIGHEST for action port [ 1019.271256] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-261361c9-81c8-47fa-9a8a-4e37a8a439d7 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.271781] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.271781] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.272064] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.272122] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('261361c9-81c8-47fa-9a8a-4e37a8a439d7',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.273253] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-261361c9-81c8-47fa-9a8a-4e37a8a439d7 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.273364] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.273435] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.273612] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.273890] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.273890] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.273890] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.274064] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.274116] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.274208] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('261361c9-81c8-47fa-9a8a-4e37a8a439d7',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.275022] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-908fc422-2790-4112-bef9-4b29d1594168 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.275131] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-908fc422-2790-4112-bef9-4b29d1594168" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.275464] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-908fc422-2790-4112-bef9-4b29d1594168" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.275464] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-908fc422-2790-4112-bef9-4b29d1594168" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.275464] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('908fc422-2790-4112-bef9-4b29d1594168',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.417092] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.417092] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.417340] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.417393] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.417524] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.417631] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 is going to be updated. [ 1019.449444] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.449665] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.449665] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.450098] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.450098] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.459129] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 in Status: IN_PROGRESS for 2s [ 1019.564643] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fdf99f09-b7da-4a5c-af72-042c6f58dc8e: rpc.has_security_group_logging(os_id): False [ 1019.587973] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.588146] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.588204] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.588412] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.588501] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.588728] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.588802] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.588854] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.590044] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.590212] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.590458] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.590567] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.590631] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.590792] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.590876] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.591175] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.591344] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.591447] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.591626] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.591746] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.591876] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fdf99f09-b7da-4a5c-af72-042c6f58dc8e is going to be created. [ 1019.649591] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.649804] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.649880] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.650508] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.650692] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.665774] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fdf99f09-b7da-4a5c-af72-042c6f58dc8e in Status: IN_PROGRESS for 2s [ 1019.777157] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-261361c9-81c8-47fa-9a8a-4e37a8a439d7 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.777536] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.777536] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('261361c9-81c8-47fa-9a8a-4e37a8a439d7',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.778996] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 908fc422-2790-4112-bef9-4b29d1594168 with status ACTIVE [ 1019.778996] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.778996] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.778996] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.778996] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.779218] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.779218] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.779287] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.779375] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.779501] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.779577] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.779866] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.779974] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.780031] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.780219] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.780295] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.780353] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 908fc422-2790-4112-bef9-4b29d1594168 is going to be updated. [ 1019.826842] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.826999] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.827150] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.827363] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.827632] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.827694] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-908fc422-2790-4112-bef9-4b29d1594168" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.031331] env[68328]: INFO networking_nsxv3.common.synchronization [req-850b801f-8ebd-482d-9479-e64acad13dc2 req-c0b50708-7c3e-42c1-96d3-7b8ffc4c1603 tempest-ServersTestJSON-1771388484 tempest-ServersTestJSON-1771388484-project-member] Enqueued Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_members [ 1020.034371] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_members [ 1020.034892] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-5841566c-1d05-4389-b8a7-950b5f9c6708 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.035299] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.035510] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.036530] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.036530] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.036530] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.038020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.038020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.038020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.038020] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.282414] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('261361c9-81c8-47fa-9a8a-4e37a8a439d7',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.341927] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-384 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.342147] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-384" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.342287] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-384" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.342627] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-384" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.342897] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.343136] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.343191] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.343411] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.343557] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.343773] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1020.343892] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1020.344025] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1020.344148] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1020.344266] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1020.344376] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1020.344514] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1020.363983] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1020.364246] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1020.364413] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1020.364603] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-384" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.365136] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-7010f338-5b8d-4a87-a094-dddfdda2cd36 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.365364] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-7010f338-5b8d-4a87-a094-dddfdda2cd36" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.365508] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-7010f338-5b8d-4a87-a094-dddfdda2cd36" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.365845] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-7010f338-5b8d-4a87-a094-dddfdda2cd36" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.365993] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7010f338-5b8d-4a87-a094-dddfdda2cd36',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.540786] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.540969] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.541073] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.541288] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.541382] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.541598] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.541708] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.541800] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.541961] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.542624] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.542624] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 already deleted. [ 1020.542624] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.785858] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.786197] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.786197] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.786267] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.786297] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.786391] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 is going to be created. [ 1020.810683] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.810874] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.810951] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.811210] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.811419] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.822566] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 in Status: UNINITIALIZED for 2s [ 1020.869149] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.869420] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.869596] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.869869] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.870035] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.870222] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 7010f338-5b8d-4a87-a094-dddfdda2cd36 not found, creating... [ 1020.870511] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.870672] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.870812] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.871145] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.871300] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.871604] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.871844] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.872013] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.872267] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.872412] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.872565] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 7010f338-5b8d-4a87-a094-dddfdda2cd36 is going to be created. [ 1020.893556] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.893744] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.893870] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.894215] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.894472] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.894753] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-7010f338-5b8d-4a87-a094-dddfdda2cd36" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.470385] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 in Status: SUCCESS [ 1021.470783] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.470896] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.471206] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.471430] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.471558] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.471625] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.471808] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.471944] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.472089] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.472236] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('398e93bc-b7ea-4684-aa02-2e6ab22c1fe5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.649878] env[68328]: INFO networking_nsxv3.common.synchronization [req-850b801f-8ebd-482d-9479-e64acad13dc2 req-e625a4ea-b3de-4c83-8185-72b16989270a service nova] Enqueued Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_rules [ 1021.650162] env[68328]: INFO networking_nsxv3.common.synchronization [req-850b801f-8ebd-482d-9479-e64acad13dc2 req-e625a4ea-b3de-4c83-8185-72b16989270a service nova] Enqueued Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_members [ 1021.650285] env[68328]: INFO networking_nsxv3.common.synchronization [req-850b801f-8ebd-482d-9479-e64acad13dc2 req-e625a4ea-b3de-4c83-8185-72b16989270a service nova] Enqueued Resource ID: 7010f338-5b8d-4a87-a094-dddfdda2cd36 with Priority: HIGHEST for action port [ 1021.650582] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_rules [ 1021.650582] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_members [ 1021.650807] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7010f338-5b8d-4a87-a094-dddfdda2cd36 with Priority: HIGHEST for action port [ 1021.652085] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5841566c-1d05-4389-b8a7-950b5f9c6708 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.652085] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.652085] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.652085] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.652085] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.652489] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-5841566c-1d05-4389-b8a7-950b5f9c6708 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.652632] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.652676] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.652824] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.655106] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.655106] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.655106] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.655106] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.655106] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.655106] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.655635] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-7010f338-5b8d-4a87-a094-dddfdda2cd36 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.655743] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7010f338-5b8d-4a87-a094-dddfdda2cd36" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.659373] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7010f338-5b8d-4a87-a094-dddfdda2cd36" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.659373] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7010f338-5b8d-4a87-a094-dddfdda2cd36" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.659373] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7010f338-5b8d-4a87-a094-dddfdda2cd36',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.677977] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fdf99f09-b7da-4a5c-af72-042c6f58dc8e in Status: SUCCESS [ 1021.678230] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.881068] env[68328]: INFO networking_nsxv3.common.synchronization [None req-301e8d10-d7e7-4010-8274-98ad2d26d984 tempest-AttachInterfacesTestJSON-966841523 tempest-AttachInterfacesTestJSON-966841523-project-member] Enqueued Resource ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 with Priority: HIGHEST for action security_group_members [ 1021.881647] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 with Priority: HIGHEST for action security_group_members [ 1021.882166] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.882166] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.882293] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.882433] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.886015] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.886015] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.886015] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.886015] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.886015] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.886015] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('398e93bc-b7ea-4684-aa02-2e6ab22c1fe5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.975172] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.975339] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.161524] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-5841566c-1d05-4389-b8a7-950b5f9c6708 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.161688] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.161848] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.162808] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7010f338-5b8d-4a87-a094-dddfdda2cd36 with status ACTIVE [ 1022.163038] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.163179] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.163255] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.163492] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.163626] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.163757] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.163852] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.163905] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.164084] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.164195] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.164341] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.164429] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.164491] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.164636] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.164717] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.164804] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7010f338-5b8d-4a87-a094-dddfdda2cd36 is going to be updated. [ 1022.184600] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.185696] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.185696] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.185696] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.185696] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.185696] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7010f338-5b8d-4a87-a094-dddfdda2cd36" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.387502] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('398e93bc-b7ea-4684-aa02-2e6ab22c1fe5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.667292] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.833757] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 in Status: SUCCESS [ 1022.834286] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.834286] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.834571] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.834835] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.835010] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.835117] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.835339] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.835453] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.835565] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.835692] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('261361c9-81c8-47fa-9a8a-4e37a8a439d7',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.889851] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('398e93bc-b7ea-4684-aa02-2e6ab22c1fe5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.171948] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.171948] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.171948] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.171948] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.171948] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.171948] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 is going to be created. [ 1023.192935] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.193090] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.193221] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.193733] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.193733] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.203338] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: UNINITIALIZED for 2s [ 1023.338566] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-261361c9-81c8-47fa-9a8a-4e37a8a439d7 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.339826] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.339826] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.340228] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.340735] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.340735] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.340735] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.340909] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.341024] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.341139] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.341820] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-261361c9-81c8-47fa-9a8a-4e37a8a439d7 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.341820] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.341820] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.342009] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.342259] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.342393] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.342488] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.342691] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.342819] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.343896] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.343896] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('261361c9-81c8-47fa-9a8a-4e37a8a439d7',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.394381] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.394381] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.394381] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.394381] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.394381] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.394381] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 is going to be updated. [ 1023.421643] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.421643] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.421643] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.421863] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.422059] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.430765] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 in Status: IN_PROGRESS for 2s [ 1023.846896] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 261361c9-81c8-47fa-9a8a-4e37a8a439d7: rpc.has_security_group_logging(os_id): False [ 1023.866074] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.866231] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.866304] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.866521] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.866612] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.866819] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.867044] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.867044] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.867305] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.867305] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.867371] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.867467] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.867521] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.867658] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.867733] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.868347] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.868347] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.868347] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.868347] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.868569] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.868569] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 is going to be created. [ 1023.931971] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.932682] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.932682] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.932682] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.932682] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.943650] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 in Status: IN_PROGRESS for 2s [ 1024.027969] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-615 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.028267] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-615" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.028440] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-615" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.028762] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-615" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.030099] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.030322] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.030455] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.030707] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.030864] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.031099] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1024.031264] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1024.031337] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1024.031443] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1024.031558] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1024.031668] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1024.031816] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1024.051939] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1024.053091] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1024.053091] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1024.053091] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-615" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.053091] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-000e9bd0-9814-49b5-83f8-e1491e5f1df0 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.053091] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-000e9bd0-9814-49b5-83f8-e1491e5f1df0" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.053091] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-000e9bd0-9814-49b5-83f8-e1491e5f1df0" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.053365] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-000e9bd0-9814-49b5-83f8-e1491e5f1df0" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.053511] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('000e9bd0-9814-49b5-83f8-e1491e5f1df0',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.556502] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.556700] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.556879] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.557211] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.557362] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.557520] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 000e9bd0-9814-49b5-83f8-e1491e5f1df0 not found, creating... [ 1024.557807] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.557961] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.558112] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.558314] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.558449] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.558741] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.558886] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.559011] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.559470] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.559722] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.560023] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 000e9bd0-9814-49b5-83f8-e1491e5f1df0 is going to be created. [ 1024.589424] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.589424] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.589424] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.589424] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.589424] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.589779] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-000e9bd0-9814-49b5-83f8-e1491e5f1df0" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.213438] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: SUCCESS [ 1025.213438] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.213438] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.213438] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.213438] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.213883] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.213883] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.213883] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.213883] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.213883] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.213883] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.291023] env[68328]: INFO networking_nsxv3.common.synchronization [req-d596e962-9702-4c9f-821c-8a86fe875817 req-d76152f2-3570-47c6-bbb7-f2b2d83556cb service nova] Enqueued Resource ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 with Priority: HIGHEST for action security_group_rules [ 1025.291023] env[68328]: INFO networking_nsxv3.common.synchronization [req-d596e962-9702-4c9f-821c-8a86fe875817 req-d76152f2-3570-47c6-bbb7-f2b2d83556cb service nova] Enqueued Resource ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 with Priority: HIGHEST for action security_group_members [ 1025.291023] env[68328]: INFO networking_nsxv3.common.synchronization [req-d596e962-9702-4c9f-821c-8a86fe875817 req-d76152f2-3570-47c6-bbb7-f2b2d83556cb service nova] Enqueued Resource ID: 000e9bd0-9814-49b5-83f8-e1491e5f1df0 with Priority: HIGHEST for action port [ 1025.291023] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 with Priority: HIGHEST for action security_group_rules [ 1025.291023] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 with Priority: HIGHEST for action security_group_members [ 1025.291023] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 000e9bd0-9814-49b5-83f8-e1491e5f1df0 with Priority: HIGHEST for action port [ 1025.291690] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.292034] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.292725] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.293150] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.293906] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-000e9bd0-9814-49b5-83f8-e1491e5f1df0 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.293906] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-000e9bd0-9814-49b5-83f8-e1491e5f1df0" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.293906] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-000e9bd0-9814-49b5-83f8-e1491e5f1df0" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.293906] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-000e9bd0-9814-49b5-83f8-e1491e5f1df0" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.293906] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('000e9bd0-9814-49b5-83f8-e1491e5f1df0',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.440018] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 in Status: SUCCESS [ 1025.440245] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.440399] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.440612] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.440801] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.440915] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.440971] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.441142] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.441220] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.441357] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.441457] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.441529] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.441581] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.441717] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.441854] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.441954] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.442025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.442168] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.442246] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.442377] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.442432] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('398e93bc-b7ea-4684-aa02-2e6ab22c1fe5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.443200] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.443589] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.443589] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.443589] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.443730] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.443811] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.443890] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.443971] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('398e93bc-b7ea-4684-aa02-2e6ab22c1fe5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.716763] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-5841566c-1d05-4389-b8a7-950b5f9c6708 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.717475] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.717475] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.717475] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.717475] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.717475] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.717475] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.717916] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.717916] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.717916] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.717916] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-5841566c-1d05-4389-b8a7-950b5f9c6708 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.718083] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.718083] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.718192] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.718319] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.718408] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.718467] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.718596] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.718672] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.718750] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.718964] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.796566] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 000e9bd0-9814-49b5-83f8-e1491e5f1df0 with status ACTIVE [ 1025.797109] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.797109] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.797109] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.797642] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.797642] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.797642] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.797828] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.797828] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.797926] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.797975] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.798150] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.798232] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.798283] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.798452] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.798530] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.798614] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 000e9bd0-9814-49b5-83f8-e1491e5f1df0 is going to be updated. [ 1025.817834] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.818061] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.818192] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.818501] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.818621] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.818840] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-000e9bd0-9814-49b5-83f8-e1491e5f1df0" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.945106] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5: rpc.has_security_group_logging(os_id): False [ 1025.945979] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('398e93bc-b7ea-4684-aa02-2e6ab22c1fe5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.958356] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 in Status: SUCCESS [ 1025.958887] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.961873] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.962034] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.962099] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.962269] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.962351] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.962532] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.962635] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.962711] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.962864] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.962916] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.963068] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.963157] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.963224] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.963345] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.963414] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.963605] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.963694] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.963747] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.963880] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.963954] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.964048] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 is going to be updated. [ 1026.035640] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.035807] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.035906] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.036125] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.036271] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.049541] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 in Status: IN_PROGRESS for 2s [ 1026.221430] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5841566c-1d05-4389-b8a7-950b5f9c6708: rpc.has_security_group_logging(os_id): False [ 1026.240056] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.240632] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.240632] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.240632] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.240632] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.240893] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.240893] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.241044] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.241153] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.241227] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.241368] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.241472] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.241539] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.241639] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.241707] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.241903] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.242022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.242094] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.242763] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.242763] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.242763] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 is going to be created. [ 1026.335349] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.335499] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.335569] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.335812] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.335986] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.348822] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: IN_PROGRESS for 2s [ 1026.448677] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('398e93bc-b7ea-4684-aa02-2e6ab22c1fe5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.588303] env[68328]: INFO networking_nsxv3.common.synchronization [req-9f00d91a-2719-4129-b521-cf1ff5b2a52b req-441456f8-2bf9-4ce6-bad1-a412a488195a tempest-ServersNegativeTestJSON-1560044281 tempest-ServersNegativeTestJSON-1560044281-project-member] Enqueued Resource ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f with Priority: HIGHEST for action security_group_members [ 1026.588930] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f with Priority: HIGHEST for action security_group_members [ 1026.589299] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.589416] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.589477] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.589744] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.589942] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.590799] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.591507] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.591794] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.591887] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.591996] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0bcdd73-03e5-43ee-a623-9ac2490cee8f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.951091] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.951245] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.951329] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.951544] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.951636] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.951736] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 is going to be updated. [ 1026.998015] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.998201] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.998281] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.998515] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.998759] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.008221] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 in Status: IN_PROGRESS for 2s [ 1027.028988] env[68328]: INFO networking_nsxv3.common.synchronization [req-25bc9727-5f0b-4225-9d6d-05ead915a90b req-2c3cbf68-7603-4b72-ba9c-1dfccb3a05b5 tempest-ListServerFiltersTestJSON-1110536152 tempest-ListServerFiltersTestJSON-1110536152-project-member] Enqueued Resource ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f with Priority: HIGHEST for action security_group_members [ 1027.028988] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f with Priority: HIGHEST for action security_group_members [ 1027.028988] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.028988] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.028988] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.028988] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.028988] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.028988] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.028988] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.029505] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.029505] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.029505] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5812c2b-73e7-421d-b4bb-29c4ef848f3f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.095890] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.096079] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.096147] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.096369] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.096461] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.096697] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.096798] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.096881] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.097067] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.097201] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.097312] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f already deleted. [ 1027.097557] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.328990] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-188 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.329312] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-188" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.329854] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-188" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.330379] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-188" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.330742] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.330990] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.331189] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.331541] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.331845] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.332240] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1027.332498] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1027.332753] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1027.332998] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1027.333282] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1027.333519] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1027.333816] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1027.355455] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1027.355640] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1027.355783] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1027.355974] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-188" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.356322] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-8bb3756c-995f-4283-8751-79df76d83d16 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.356497] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-8bb3756c-995f-4283-8751-79df76d83d16" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.356722] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-8bb3756c-995f-4283-8751-79df76d83d16" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.357071] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-8bb3756c-995f-4283-8751-79df76d83d16" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.357275] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8bb3756c-995f-4283-8751-79df76d83d16',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.531877] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.532109] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.532226] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.532462] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.550806] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.551043] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.551168] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.551236] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.551444] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.551527] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.551616] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f is going to be updated. [ 1027.575029] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.575029] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.575155] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.575300] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.575694] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.583023] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f in Status: IN_PROGRESS for 2s [ 1027.859310] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.859544] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.859807] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.860074] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.860259] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.860430] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 8bb3756c-995f-4283-8751-79df76d83d16 not found, creating... [ 1027.860713] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.860932] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.861084] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.861380] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.861560] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.861947] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.862254] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.862481] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.862748] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.862989] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.863211] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 8bb3756c-995f-4283-8751-79df76d83d16 is going to be created. [ 1027.882515] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.882826] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.882994] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.883317] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.883554] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.883783] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-8bb3756c-995f-4283-8751-79df76d83d16" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.065435] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 in Status: SUCCESS [ 1028.065435] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.065617] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.065841] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.065954] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('398e93bc-b7ea-4684-aa02-2e6ab22c1fe5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.360980] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: SUCCESS [ 1028.361274] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.570527] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.570677] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.799487] env[68328]: INFO networking_nsxv3.common.synchronization [req-9f00d91a-2719-4129-b521-cf1ff5b2a52b req-13d395a7-4b07-4a43-9842-b8dd4ae5b63a service nova] Enqueued Resource ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f with Priority: HIGHEST for action security_group_rules [ 1028.799487] env[68328]: INFO networking_nsxv3.common.synchronization [req-9f00d91a-2719-4129-b521-cf1ff5b2a52b req-13d395a7-4b07-4a43-9842-b8dd4ae5b63a service nova] Enqueued Resource ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f with Priority: HIGHEST for action security_group_members [ 1028.799487] env[68328]: INFO networking_nsxv3.common.synchronization [req-9f00d91a-2719-4129-b521-cf1ff5b2a52b req-13d395a7-4b07-4a43-9842-b8dd4ae5b63a service nova] Enqueued Resource ID: 8bb3756c-995f-4283-8751-79df76d83d16 with Priority: HIGHEST for action port [ 1028.799487] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f with Priority: HIGHEST for action security_group_rules [ 1028.799487] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f with Priority: HIGHEST for action security_group_members [ 1028.799487] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bb3756c-995f-4283-8751-79df76d83d16 with Priority: HIGHEST for action port [ 1028.799487] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f0bcdd73-03e5-43ee-a623-9ac2490cee8f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.800203] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.800401] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.800743] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.804021] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f0bcdd73-03e5-43ee-a623-9ac2490cee8f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.804021] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.804021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.804021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.804021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.804021] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.804021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.804021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.804021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.804021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.804021] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0bcdd73-03e5-43ee-a623-9ac2490cee8f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.804773] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-8bb3756c-995f-4283-8751-79df76d83d16 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.805092] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8bb3756c-995f-4283-8751-79df76d83d16" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.805287] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8bb3756c-995f-4283-8751-79df76d83d16" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.805518] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8bb3756c-995f-4283-8751-79df76d83d16" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.805673] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8bb3756c-995f-4283-8751-79df76d83d16',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.017311] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 in Status: SUCCESS [ 1029.017552] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.017754] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.017967] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.018167] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.018279] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.018335] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.018498] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.018568] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.019080] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.019080] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('398e93bc-b7ea-4684-aa02-2e6ab22c1fe5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.307933] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.308074] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.308257] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f0bcdd73-03e5-43ee-a623-9ac2490cee8f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.309103] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8bb3756c-995f-4283-8751-79df76d83d16 with status ACTIVE [ 1029.309226] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.309445] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.309445] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.309588] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.309683] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.309850] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.310316] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.310408] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.310567] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.310650] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.310835] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.310955] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.310997] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.311134] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.311198] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.311335] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8bb3756c-995f-4283-8751-79df76d83d16 is going to be updated. [ 1029.331518] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.331704] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.331704] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.331919] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.332090] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.332223] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8bb3756c-995f-4283-8751-79df76d83d16" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.521234] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.521564] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.521564] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.521679] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.521859] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.521985] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.522075] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.522174] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.522263] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.522351] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.522499] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.522586] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.522647] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.522787] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.522933] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.523035] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.523092] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.523229] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.523304] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.523384] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.523471] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('398e93bc-b7ea-4684-aa02-2e6ab22c1fe5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.606517] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f in Status: SUCCESS [ 1029.606692] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f deletion is rescheduled due to dependency. [ 1029.606802] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.813703] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f0bcdd73-03e5-43ee-a623-9ac2490cee8f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.026040] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5: rpc.has_security_group_logging(os_id): False [ 1030.045684] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.045684] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.045684] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.045977] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.045977] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.047353] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.047353] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.047353] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.047353] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.047353] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.047353] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.047353] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.047353] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.047353] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.047353] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.047889] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.047889] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.047889] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.047889] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.047889] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.047889] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 is going to be updated. [ 1030.108261] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.108550] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.108550] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.108745] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.108902] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.124161] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 in Status: IN_PROGRESS for 2s [ 1030.317844] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.318042] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.318100] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.318326] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.318418] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.318522] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f is going to be created. [ 1030.341908] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.342298] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.342298] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.342533] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.342726] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.352382] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f in Status: UNINITIALIZED for 2s [ 1032.044678] env[68328]: INFO networking_nsxv3.common.synchronization [req-9921128e-b8dc-4870-960e-8c16a76e7e1c req-bef49a3e-ee16-4c1f-8304-2d0759b315ce tempest-ServerGroupTestJSON-893083902 tempest-ServerGroupTestJSON-893083902-project-member] Enqueued Resource ID: 3b0dcde5-1c71-45fa-b1b1-331b2ba39902 with Priority: HIGHEST for action security_group_members [ 1032.044678] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b0dcde5-1c71-45fa-b1b1-331b2ba39902 with Priority: HIGHEST for action security_group_members [ 1032.045075] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b0dcde5-1c71-45fa-b1b1-331b2ba39902 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.045075] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b0dcde5-1c71-45fa-b1b1-331b2ba39902" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.045075] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b0dcde5-1c71-45fa-b1b1-331b2ba39902" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.045497] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b0dcde5-1c71-45fa-b1b1-331b2ba39902" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.045618] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.045733] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.045795] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.045951] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.046099] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.046176] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b0dcde5-1c71-45fa-b1b1-331b2ba39902',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.142461] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 in Status: SUCCESS [ 1032.142461] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.362030] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f in Status: SUCCESS [ 1032.362955] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.362955] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.362955] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.363182] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.363318] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.363446] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.363618] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.363779] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.363841] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.363977] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f0bcdd73-03e5-43ee-a623-9ac2490cee8f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.378436] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-717 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.378668] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-717" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.378821] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-717" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.379310] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-717" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.379620] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.379789] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.379950] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.380214] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.380403] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.380636] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1032.380738] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1032.380863] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1032.380998] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1032.381135] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1032.381252] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1032.381377] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1032.399566] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1032.399815] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1032.400092] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1032.400307] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-717" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.400666] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-0782ff56-fa20-498b-937b-24f6ea102ff4 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.400861] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-0782ff56-fa20-498b-937b-24f6ea102ff4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.400974] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-0782ff56-fa20-498b-937b-24f6ea102ff4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.401340] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-0782ff56-fa20-498b-937b-24f6ea102ff4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.401512] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0782ff56-fa20-498b-937b-24f6ea102ff4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.550121] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.550121] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.550121] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.550121] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.550121] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.550485] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.550485] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.550485] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.550672] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.550748] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.550837] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b0dcde5-1c71-45fa-b1b1-331b2ba39902 already deleted. [ 1032.550919] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b0dcde5-1c71-45fa-b1b1-331b2ba39902" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.866835] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.867096] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.867196] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.867454] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.867662] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.867988] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.867988] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.868258] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.868416] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.868520] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.868703] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.868795] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.868846] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.869098] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.869288] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.869408] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.869462] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.869615] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.869692] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.869773] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.869901] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f0bcdd73-03e5-43ee-a623-9ac2490cee8f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.904442] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.904825] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.904825] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.905112] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.905307] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.905443] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 0782ff56-fa20-498b-937b-24f6ea102ff4 not found, creating... [ 1032.905799] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.906229] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.906229] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.906447] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.906653] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.907101] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.907337] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.907492] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.907774] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.907947] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.908136] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 0782ff56-fa20-498b-937b-24f6ea102ff4 is going to be created. [ 1032.930534] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.931729] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.931729] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.931729] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.932087] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.932604] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-0782ff56-fa20-498b-937b-24f6ea102ff4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.372450] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f0bcdd73-03e5-43ee-a623-9ac2490cee8f: rpc.has_security_group_logging(os_id): False [ 1033.390355] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.390943] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.391047] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.391296] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.391390] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.391673] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.391737] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.391787] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.391993] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.392083] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.392298] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.392350] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.392411] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.392629] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.392629] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.392791] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.392881] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.392942] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.393449] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.393596] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.393726] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f is going to be created. [ 1033.448461] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.448461] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.448461] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.448823] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.449120] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.459610] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f in Status: IN_PROGRESS for 2s [ 1033.561374] env[68328]: INFO networking_nsxv3.common.synchronization [req-24534be8-21e7-4d53-a21b-a2968ce2dbd7 req-72a49f30-8218-4ad8-b42b-56753b34baab tempest-ImagesTestJSON-69996350 tempest-ImagesTestJSON-69996350-project-member] Enqueued Resource ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 with Priority: HIGHEST for action security_group_members [ 1033.562016] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 with Priority: HIGHEST for action security_group_members [ 1033.562295] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-249b36cf-74ee-44d9-b2c9-d728a30d9a09 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.562486] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.562593] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.562825] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.563037] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.563159] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.563249] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.563441] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.563547] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.564096] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('249b36cf-74ee-44d9-b2c9-d728a30d9a09',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.841181] env[68328]: INFO networking_nsxv3.common.synchronization [req-9921128e-b8dc-4870-960e-8c16a76e7e1c req-3cbce0d5-0b88-4d3e-8282-37eaa74c0c2b service nova] Enqueued Resource ID: 3b0dcde5-1c71-45fa-b1b1-331b2ba39902 with Priority: HIGHEST for action security_group_rules [ 1033.841416] env[68328]: INFO networking_nsxv3.common.synchronization [req-9921128e-b8dc-4870-960e-8c16a76e7e1c req-3cbce0d5-0b88-4d3e-8282-37eaa74c0c2b service nova] Enqueued Resource ID: 3b0dcde5-1c71-45fa-b1b1-331b2ba39902 with Priority: HIGHEST for action security_group_members [ 1033.841581] env[68328]: INFO networking_nsxv3.common.synchronization [req-9921128e-b8dc-4870-960e-8c16a76e7e1c req-3cbce0d5-0b88-4d3e-8282-37eaa74c0c2b service nova] Enqueued Resource ID: 0782ff56-fa20-498b-937b-24f6ea102ff4 with Priority: HIGHEST for action port [ 1033.842793] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b0dcde5-1c71-45fa-b1b1-331b2ba39902 with Priority: HIGHEST for action security_group_rules [ 1033.842963] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b0dcde5-1c71-45fa-b1b1-331b2ba39902 with Priority: HIGHEST for action security_group_members [ 1033.843163] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0782ff56-fa20-498b-937b-24f6ea102ff4 with Priority: HIGHEST for action port [ 1033.843573] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3b0dcde5-1c71-45fa-b1b1-331b2ba39902 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.843737] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3b0dcde5-1c71-45fa-b1b1-331b2ba39902" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.843821] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3b0dcde5-1c71-45fa-b1b1-331b2ba39902" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.844121] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3b0dcde5-1c71-45fa-b1b1-331b2ba39902" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.844280] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3b0dcde5-1c71-45fa-b1b1-331b2ba39902',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.845320] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b0dcde5-1c71-45fa-b1b1-331b2ba39902 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.845320] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b0dcde5-1c71-45fa-b1b1-331b2ba39902" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.845482] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b0dcde5-1c71-45fa-b1b1-331b2ba39902" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.849024] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b0dcde5-1c71-45fa-b1b1-331b2ba39902" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.849024] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.849024] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.849024] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.849024] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.849024] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.849024] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b0dcde5-1c71-45fa-b1b1-331b2ba39902',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.849024] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-0782ff56-fa20-498b-937b-24f6ea102ff4 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.849024] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0782ff56-fa20-498b-937b-24f6ea102ff4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.849024] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0782ff56-fa20-498b-937b-24f6ea102ff4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.849024] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0782ff56-fa20-498b-937b-24f6ea102ff4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.849024] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0782ff56-fa20-498b-937b-24f6ea102ff4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.014989] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-834 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.015228] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-834" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.015366] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-834" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.015659] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-834" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.015939] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.020274] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.020483] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.020758] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.021176] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.023912] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1034.024099] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1034.024231] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1034.024399] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1034.024582] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1034.024707] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1034.024858] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1034.047121] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1034.047339] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1034.047489] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1034.047736] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-834" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.048147] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-529edb07-e56c-478c-8f0b-fd74650c074c taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.048349] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-529edb07-e56c-478c-8f0b-fd74650c074c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.048505] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-529edb07-e56c-478c-8f0b-fd74650c074c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.048862] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-529edb07-e56c-478c-8f0b-fd74650c074c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.049229] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('529edb07-e56c-478c-8f0b-fd74650c074c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.068294] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.068294] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.068294] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.068453] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.068719] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.068815] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.068907] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.068965] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.069114] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.069205] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.069305] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 is going to be updated. [ 1034.098179] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.098179] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.098179] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.098179] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.098179] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.107740] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 in Status: IN_PROGRESS for 2s [ 1034.350671] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b0dcde5-1c71-45fa-b1b1-331b2ba39902 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.350671] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b0dcde5-1c71-45fa-b1b1-331b2ba39902" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.357790] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0782ff56-fa20-498b-937b-24f6ea102ff4 with status ACTIVE [ 1034.357790] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.357790] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.357790] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.357790] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.357790] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.357790] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.357790] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.357790] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.357790] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.357790] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.357790] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.357790] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.357790] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.357790] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.357790] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.357790] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0782ff56-fa20-498b-937b-24f6ea102ff4 is going to be updated. [ 1034.364021] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3b0dcde5-1c71-45fa-b1b1-331b2ba39902',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.381601] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.381601] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.381601] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.381601] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.381601] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.381601] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0782ff56-fa20-498b-937b-24f6ea102ff4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.551809] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.552115] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.552254] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.552561] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.552736] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.552907] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 529edb07-e56c-478c-8f0b-fd74650c074c not found, creating... [ 1034.553241] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.553427] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.553572] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.553835] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.553972] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.554342] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.554527] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.554661] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.554905] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.555066] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.555218] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 529edb07-e56c-478c-8f0b-fd74650c074c is going to be created. [ 1034.576571] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.576861] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.577100] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.577504] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.577881] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.578604] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-529edb07-e56c-478c-8f0b-fd74650c074c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.863113] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3b0dcde5-1c71-45fa-b1b1-331b2ba39902',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.366918] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.367126] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.367278] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.367390] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.367485] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.367598] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b0dcde5-1c71-45fa-b1b1-331b2ba39902 is going to be created. [ 1035.383455] env[68328]: INFO networking_nsxv3.common.synchronization [None req-1c066cd2-e06c-4246-b8ad-4a35bc174865 None None] Enqueued Resource ID: 100f640e-245c-4607-9f60-8f83e9b6998c with Priority: HIGHEST for action port [ 1035.384927] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 100f640e-245c-4607-9f60-8f83e9b6998c with Priority: HIGHEST for action port [ 1035.384927] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-100f640e-245c-4607-9f60-8f83e9b6998c taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.384927] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-100f640e-245c-4607-9f60-8f83e9b6998c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.384927] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-100f640e-245c-4607-9f60-8f83e9b6998c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.384927] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-100f640e-245c-4607-9f60-8f83e9b6998c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.384927] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('100f640e-245c-4607-9f60-8f83e9b6998c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.389032] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.389032] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.389229] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.389281] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.389430] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.401937] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b0dcde5-1c71-45fa-b1b1-331b2ba39902 in Status: UNINITIALIZED for 2s [ 1035.469436] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f in Status: SUCCESS [ 1035.471773] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.674361] env[68328]: INFO networking_nsxv3.common.synchronization [req-24534be8-21e7-4d53-a21b-a2968ce2dbd7 req-a2bc7dc9-e317-4161-9ec4-b3f44e10dd12 service nova] Enqueued Resource ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 with Priority: HIGHEST for action security_group_rules [ 1035.674635] env[68328]: INFO networking_nsxv3.common.synchronization [req-24534be8-21e7-4d53-a21b-a2968ce2dbd7 req-a2bc7dc9-e317-4161-9ec4-b3f44e10dd12 service nova] Enqueued Resource ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 with Priority: HIGHEST for action security_group_members [ 1035.674781] env[68328]: INFO networking_nsxv3.common.synchronization [req-24534be8-21e7-4d53-a21b-a2968ce2dbd7 req-a2bc7dc9-e317-4161-9ec4-b3f44e10dd12 service nova] Enqueued Resource ID: 529edb07-e56c-478c-8f0b-fd74650c074c with Priority: HIGHEST for action port [ 1035.675032] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 with Priority: HIGHEST for action security_group_rules [ 1035.675166] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 with Priority: HIGHEST for action security_group_members [ 1035.675261] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 529edb07-e56c-478c-8f0b-fd74650c074c with Priority: HIGHEST for action port [ 1035.676353] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-249b36cf-74ee-44d9-b2c9-d728a30d9a09 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.676353] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.676353] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.676353] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.676353] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('249b36cf-74ee-44d9-b2c9-d728a30d9a09',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.677615] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-249b36cf-74ee-44d9-b2c9-d728a30d9a09 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.677715] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.677941] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-529edb07-e56c-478c-8f0b-fd74650c074c taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.678082] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-529edb07-e56c-478c-8f0b-fd74650c074c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.678162] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-529edb07-e56c-478c-8f0b-fd74650c074c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.678274] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-529edb07-e56c-478c-8f0b-fd74650c074c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.678352] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('529edb07-e56c-478c-8f0b-fd74650c074c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.888026] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 100f640e-245c-4607-9f60-8f83e9b6998c [ 1035.888146] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.891021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.891021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.891021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.891021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.891021] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:100f640e-245c-4607-9f60-8f83e9b6998c already deleted. [ 1035.891021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-100f640e-245c-4607-9f60-8f83e9b6998c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.118218] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 in Status: IN_PROGRESS for 4s [ 1036.181051] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-249b36cf-74ee-44d9-b2c9-d728a30d9a09 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.181051] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.181051] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 529edb07-e56c-478c-8f0b-fd74650c074c with status ACTIVE [ 1036.181051] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.181051] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.181051] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.181051] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.181051] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.181678] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.181678] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.181678] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.181678] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.181678] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.181975] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.181975] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.181975] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.182144] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.182176] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.182364] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 529edb07-e56c-478c-8f0b-fd74650c074c is going to be updated. [ 1036.208245] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.208345] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.208414] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.208619] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.208751] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.208911] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-529edb07-e56c-478c-8f0b-fd74650c074c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.438814] env[68328]: INFO networking_nsxv3.common.synchronization [None req-08cda8c6-009c-49b9-be65-ef2120eec469 tempest-ServersTestFqdnHostnames-31007644 tempest-ServersTestFqdnHostnames-31007644-project-member] Enqueued Resource ID: b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2 with Priority: HIGHEST for action security_group_rules [ 1036.439359] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2 with Priority: HIGHEST for action security_group_rules [ 1036.439660] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.439819] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.439903] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.440106] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.440195] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.554084] env[68328]: INFO networking_nsxv3.common.synchronization [None req-5b61abc4-d226-4f85-af98-b46dd5213bc8 tempest-ServersTestFqdnHostnames-31007644 tempest-ServersTestFqdnHostnames-31007644-project-member] Enqueued Resource ID: b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2 with Priority: HIGHEST for action security_group_rules [ 1036.554643] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2 with Priority: HIGHEST for action security_group_rules [ 1036.554970] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.555095] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.968603] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.968603] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.968869] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.968869] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.968940] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.969105] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2 already deleted. [ 1036.969216] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.969342] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.969550] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.969642] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.075875] env[68328]: INFO networking_nsxv3.common.synchronization [None req-33f0acf6-95c1-4fce-b364-68e3b63b3ac9 None None] Enqueued Resource ID: 6fe07c24-7424-4d39-b0f9-7e4fca50f223 with Priority: HIGHEST for action port [ 1037.076694] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fe07c24-7424-4d39-b0f9-7e4fca50f223 with Priority: HIGHEST for action port [ 1037.077173] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-6fe07c24-7424-4d39-b0f9-7e4fca50f223 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.077408] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6fe07c24-7424-4d39-b0f9-7e4fca50f223" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.077408] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6fe07c24-7424-4d39-b0f9-7e4fca50f223" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.077675] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6fe07c24-7424-4d39-b0f9-7e4fca50f223" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.077848] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fe07c24-7424-4d39-b0f9-7e4fca50f223',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.412940] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b0dcde5-1c71-45fa-b1b1-331b2ba39902 in Status: SUCCESS [ 1037.412940] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b0dcde5-1c71-45fa-b1b1-331b2ba39902" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.412940] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b0dcde5-1c71-45fa-b1b1-331b2ba39902" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.412940] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b0dcde5-1c71-45fa-b1b1-331b2ba39902" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.412940] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.412940] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.412940] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.412940] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.412940] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.412940] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b0dcde5-1c71-45fa-b1b1-331b2ba39902" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.412940] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3b0dcde5-1c71-45fa-b1b1-331b2ba39902',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.490093] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.490093] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.490093] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.490093] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.490093] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.490093] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2 already deleted. [ 1037.490093] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.581092] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6fe07c24-7424-4d39-b0f9-7e4fca50f223 [ 1037.581149] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.581351] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.581351] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.581552] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.581640] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.581739] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6fe07c24-7424-4d39-b0f9-7e4fca50f223 already deleted. [ 1037.581820] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6fe07c24-7424-4d39-b0f9-7e4fca50f223" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.915401] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b0dcde5-1c71-45fa-b1b1-331b2ba39902 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.915568] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b0dcde5-1c71-45fa-b1b1-331b2ba39902" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.915642] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b0dcde5-1c71-45fa-b1b1-331b2ba39902" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.915861] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b0dcde5-1c71-45fa-b1b1-331b2ba39902" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.916045] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.916139] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.916197] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.916384] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.916522] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.916634] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b0dcde5-1c71-45fa-b1b1-331b2ba39902" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.916786] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b0dcde5-1c71-45fa-b1b1-331b2ba39902 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.916879] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b0dcde5-1c71-45fa-b1b1-331b2ba39902" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.916941] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b0dcde5-1c71-45fa-b1b1-331b2ba39902" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.917100] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b0dcde5-1c71-45fa-b1b1-331b2ba39902" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.917234] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.917325] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.918235] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.918235] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.918235] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.918235] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b0dcde5-1c71-45fa-b1b1-331b2ba39902" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.918235] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3b0dcde5-1c71-45fa-b1b1-331b2ba39902',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.127113] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 in Status: SUCCESS [ 1038.127332] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 deletion is rescheduled due to dependency. [ 1038.127395] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.127586] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.127820] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.128013] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.128136] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.128199] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.128347] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.128501] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.128626] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('249b36cf-74ee-44d9-b2c9-d728a30d9a09',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.354975] env[68328]: INFO networking_nsxv3.common.synchronization [req-dfba1131-ab58-48ac-a734-621a070228bd req-35af2d0d-046f-4425-ac2b-1de1656521a0 tempest-AttachInterfacesTestJSON-966841523 tempest-AttachInterfacesTestJSON-966841523-project-member] Enqueued Resource ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 with Priority: HIGHEST for action security_group_members [ 1038.358680] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 with Priority: HIGHEST for action security_group_members [ 1038.359420] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.359420] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.359420] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.359646] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.359800] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.359924] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.360011] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.360195] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.360619] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.360619] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('398e93bc-b7ea-4684-aa02-2e6ab22c1fe5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.420049] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3b0dcde5-1c71-45fa-b1b1-331b2ba39902: rpc.has_security_group_logging(os_id): False [ 1038.436575] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.436835] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.436957] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.437238] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.437395] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.437642] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.437828] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.437960] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.438183] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.438322] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.438570] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.438678] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.438742] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.438887] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.438962] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.439289] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.439449] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.439552] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.439732] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.439851] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.439977] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3b0dcde5-1c71-45fa-b1b1-331b2ba39902 is going to be created. [ 1038.492707] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.493107] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.493107] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.493311] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.493552] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.505020] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3b0dcde5-1c71-45fa-b1b1-331b2ba39902 in Status: IN_PROGRESS for 2s [ 1038.631538] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('249b36cf-74ee-44d9-b2c9-d728a30d9a09',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.862869] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('398e93bc-b7ea-4684-aa02-2e6ab22c1fe5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.138676] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('249b36cf-74ee-44d9-b2c9-d728a30d9a09',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.368434] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('398e93bc-b7ea-4684-aa02-2e6ab22c1fe5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.590951] env[68328]: INFO networking_nsxv3.common.synchronization [None req-76b7ce2a-2e48-4995-8298-2ab299669ebf tempest-AttachInterfacesTestJSON-966841523 tempest-AttachInterfacesTestJSON-966841523-project-member] Enqueued Resource ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 with Priority: HIGHEST for action security_group_members [ 1039.591599] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 with Priority: HIGHEST for action security_group_members [ 1039.592195] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.592195] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.641419] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.641672] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.641672] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.641894] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.642041] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.642215] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 is going to be updated. [ 1039.679088] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.679326] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.679326] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.679566] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.680536] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.688935] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 in Status: IN_PROGRESS for 2s [ 1039.872302] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.872621] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.872753] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.873014] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.873136] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.873274] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 is going to be updated. [ 1039.898159] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.898391] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.898391] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.898577] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.898712] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.910800] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 in Status: IN_PROGRESS for 2s [ 1040.519739] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3b0dcde5-1c71-45fa-b1b1-331b2ba39902 in Status: SUCCESS [ 1040.520632] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3b0dcde5-1c71-45fa-b1b1-331b2ba39902" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.738788] env[68328]: INFO networking_nsxv3.common.synchronization [req-a539a162-ae07-480f-974c-c83fe47a32d1 req-561874d0-8239-4e2f-be46-02f4d08ff4d1 tempest-ServerActionsTestOtherA-501294167 tempest-ServerActionsTestOtherA-501294167-project-member] Enqueued Resource ID: d7acb0b1-c9e7-4016-8d0b-c700463d32e1 with Priority: HIGHEST for action security_group_members [ 1040.739396] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7acb0b1-c9e7-4016-8d0b-c700463d32e1 with Priority: HIGHEST for action security_group_members [ 1040.740123] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.740259] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.740374] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.740617] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.740788] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.740931] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.740931] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.741103] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.741201] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.741283] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7acb0b1-c9e7-4016-8d0b-c700463d32e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.137435] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-113 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.137690] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-113" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.138072] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-113" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.138171] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-113" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.139228] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.139347] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.139489] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.139769] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.139928] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.140195] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1041.140393] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1041.140514] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1041.140564] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1041.140941] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1041.140941] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1041.140941] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1041.162560] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1041.162560] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1041.162560] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1041.162560] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-113" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.162560] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-10de07a1-d66e-4248-988e-6b274ab4e041 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.162560] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-10de07a1-d66e-4248-988e-6b274ab4e041" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.162560] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-10de07a1-d66e-4248-988e-6b274ab4e041" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.162560] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-10de07a1-d66e-4248-988e-6b274ab4e041" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.163475] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10de07a1-d66e-4248-988e-6b274ab4e041',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.246453] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.246699] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.246915] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.247172] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.247330] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.247645] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.247810] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.247922] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.248234] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.248445] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.248531] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7acb0b1-c9e7-4016-8d0b-c700463d32e1 already deleted. [ 1041.248673] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.669925] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.670229] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.670286] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.670578] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.670731] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.670890] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 10de07a1-d66e-4248-988e-6b274ab4e041 not found, creating... [ 1041.671168] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.671333] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.671514] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.671866] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.672144] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.672585] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.672818] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.672974] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.673209] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.673352] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.673529] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 10de07a1-d66e-4248-988e-6b274ab4e041 is going to be created. [ 1041.693460] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.693666] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.693795] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.694067] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.694303] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.694516] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-10de07a1-d66e-4248-988e-6b274ab4e041" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.697390] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 in Status: SUCCESS [ 1041.697571] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.697712] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.697893] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.698065] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.698160] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.698233] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.698359] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.698434] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.698515] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.698601] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('249b36cf-74ee-44d9-b2c9-d728a30d9a09',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.920276] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 in Status: SUCCESS [ 1041.920632] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.920680] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.920895] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.921121] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.921238] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.921302] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.921456] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.921534] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.921629] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('398e93bc-b7ea-4684-aa02-2e6ab22c1fe5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.201634] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-249b36cf-74ee-44d9-b2c9-d728a30d9a09 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.201788] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.202692] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.202692] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.202692] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.202692] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.202692] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.202692] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.202692] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.203059] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.203549] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-249b36cf-74ee-44d9-b2c9-d728a30d9a09 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.203649] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.203712] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.203863] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.204014] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.204108] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.204167] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.204303] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.204374] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.204452] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.204535] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('249b36cf-74ee-44d9-b2c9-d728a30d9a09',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.408735] env[68328]: INFO networking_nsxv3.common.synchronization [req-a539a162-ae07-480f-974c-c83fe47a32d1 req-239bc124-cb7e-4f3d-9faf-f9a36ae2b72e service nova] Enqueued Resource ID: d7acb0b1-c9e7-4016-8d0b-c700463d32e1 with Priority: HIGHEST for action security_group_rules [ 1042.413938] env[68328]: INFO networking_nsxv3.common.synchronization [req-a539a162-ae07-480f-974c-c83fe47a32d1 req-239bc124-cb7e-4f3d-9faf-f9a36ae2b72e service nova] Enqueued Resource ID: d7acb0b1-c9e7-4016-8d0b-c700463d32e1 with Priority: HIGHEST for action security_group_members [ 1042.413938] env[68328]: INFO networking_nsxv3.common.synchronization [req-a539a162-ae07-480f-974c-c83fe47a32d1 req-239bc124-cb7e-4f3d-9faf-f9a36ae2b72e service nova] Enqueued Resource ID: 10de07a1-d66e-4248-988e-6b274ab4e041 with Priority: HIGHEST for action port [ 1042.413938] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7acb0b1-c9e7-4016-8d0b-c700463d32e1 with Priority: HIGHEST for action security_group_rules [ 1042.413938] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7acb0b1-c9e7-4016-8d0b-c700463d32e1 with Priority: HIGHEST for action security_group_members [ 1042.413938] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10de07a1-d66e-4248-988e-6b274ab4e041 with Priority: HIGHEST for action port [ 1042.413938] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d7acb0b1-c9e7-4016-8d0b-c700463d32e1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.413938] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.413938] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.414371] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.415227] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d7acb0b1-c9e7-4016-8d0b-c700463d32e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.416532] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.416649] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.416713] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.416926] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.417095] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.417216] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.417280] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.417430] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.417513] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.417700] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7acb0b1-c9e7-4016-8d0b-c700463d32e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.418526] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-10de07a1-d66e-4248-988e-6b274ab4e041 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.418668] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-10de07a1-d66e-4248-988e-6b274ab4e041" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.418758] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-10de07a1-d66e-4248-988e-6b274ab4e041" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.418980] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-10de07a1-d66e-4248-988e-6b274ab4e041" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.419065] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10de07a1-d66e-4248-988e-6b274ab4e041',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.426305] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.426463] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.426531] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.426730] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.426813] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.427029] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.427118] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.427168] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.427311] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.427382] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.427464] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 is going to be updated. [ 1042.453127] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.453315] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.453397] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.453609] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.453756] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.462048] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 in Status: IN_PROGRESS for 2s [ 1042.710022] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 249b36cf-74ee-44d9-b2c9-d728a30d9a09: rpc.has_security_group_logging(os_id): False [ 1042.728364] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.728364] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.728364] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.728364] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.728364] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.728364] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.728364] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.728364] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.728700] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.728700] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.730188] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.730188] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.730188] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.730188] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.730188] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.730188] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.730188] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.730188] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.730188] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.730188] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.730188] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 is going to be updated. [ 1042.785249] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.785375] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.785426] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.785623] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.785822] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.807161] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 in Status: IN_PROGRESS for 2s [ 1042.923925] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d7acb0b1-c9e7-4016-8d0b-c700463d32e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.925356] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.925478] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.925612] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 10de07a1-d66e-4248-988e-6b274ab4e041 with status ACTIVE [ 1042.925765] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.925917] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.925917] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.926134] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.926223] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.926387] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.926481] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.926542] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.926696] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.926773] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.926955] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.928594] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.928701] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.928903] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.928983] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.929127] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 10de07a1-d66e-4248-988e-6b274ab4e041 is going to be updated. [ 1042.955751] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.955751] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.955751] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.955751] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.955751] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.955751] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-10de07a1-d66e-4248-988e-6b274ab4e041" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.277140] env[68328]: INFO networking_nsxv3.common.synchronization [req-c8bcf6f4-11d0-4bb2-ba49-43fcaaca61dd req-7374c139-0ed5-430d-85ac-28f685971d8d tempest-DeleteServersTestJSON-1696259291 tempest-DeleteServersTestJSON-1696259291-project-member] Enqueued Resource ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 with Priority: HIGHEST for action security_group_members [ 1043.277691] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 with Priority: HIGHEST for action security_group_members [ 1043.277986] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.278126] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.278211] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.278372] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.278515] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.279124] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.279124] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.279327] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.279327] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.279498] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c35aa45-69e7-4952-b5d8-8a7d6b3460e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.432474] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d7acb0b1-c9e7-4016-8d0b-c700463d32e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.785224] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.785224] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.785224] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.785224] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.785224] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.785224] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.785224] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.785508] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.785508] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.785508] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.785594] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 is going to be updated. [ 1043.790796] env[68328]: INFO networking_nsxv3.common.synchronization [req-e905296d-b7a8-420e-afd8-4e545d2060c6 req-4eaa9e23-0882-4173-9309-7e6c1739e807 tempest-AttachInterfacesTestJSON-966841523 tempest-AttachInterfacesTestJSON-966841523-project-member] Enqueued Resource ID: 0c5088e7-0ed1-4112-b902-8fd593a8b34e with Priority: HIGHEST for action security_group_members [ 1043.791193] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c5088e7-0ed1-4112-b902-8fd593a8b34e with Priority: HIGHEST for action security_group_members [ 1043.791623] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c5088e7-0ed1-4112-b902-8fd593a8b34e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.791770] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c5088e7-0ed1-4112-b902-8fd593a8b34e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.791819] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c5088e7-0ed1-4112-b902-8fd593a8b34e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.793051] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c5088e7-0ed1-4112-b902-8fd593a8b34e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.794514] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.794514] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.795179] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.795374] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.795474] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.795576] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c5088e7-0ed1-4112-b902-8fd593a8b34e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.811872] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.812052] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.812136] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.814063] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.814063] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.824083] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 in Status: IN_PROGRESS for 2s [ 1043.934733] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.935076] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.935076] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.935310] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.935426] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.935552] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7acb0b1-c9e7-4016-8d0b-c700463d32e1 is going to be created. [ 1043.958155] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.958338] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.958387] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.958673] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.962076] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.970827] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7acb0b1-c9e7-4016-8d0b-c700463d32e1 in Status: UNINITIALIZED for 2s [ 1044.004124] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-280 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.004323] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-280" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.004427] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-280" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.004898] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-280" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.004898] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.005950] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.006442] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.006523] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.006910] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.007974] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1044.007974] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1044.007974] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1044.007974] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1044.007974] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1044.007974] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1044.007974] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1044.034645] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1044.035478] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1044.035478] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1044.035478] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-280" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.035478] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-fe0f02bc-c96c-4cff-a2ef-152c3b84e79d taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.035651] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-fe0f02bc-c96c-4cff-a2ef-152c3b84e79d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.035651] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-fe0f02bc-c96c-4cff-a2ef-152c3b84e79d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.035973] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-fe0f02bc-c96c-4cff-a2ef-152c3b84e79d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.036412] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe0f02bc-c96c-4cff-a2ef-152c3b84e79d',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.301202] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.301202] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.301202] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.301202] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.320475] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.320829] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.320829] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.321064] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.322030] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.322030] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.322030] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c5088e7-0ed1-4112-b902-8fd593a8b34e is going to be updated. [ 1044.344986] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.345111] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.345161] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.345396] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.345489] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.358672] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c5088e7-0ed1-4112-b902-8fd593a8b34e in Status: IN_PROGRESS for 2s [ 1044.481921] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 in Status: SUCCESS [ 1044.481921] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 deletion is rescheduled due to dependency. [ 1044.481921] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.540134] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.540444] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.540622] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.540957] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.541181] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.541367] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port fe0f02bc-c96c-4cff-a2ef-152c3b84e79d not found, creating... [ 1044.541665] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.541829] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.541949] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.542309] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.546036] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.546036] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.546036] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.546036] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.546036] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.546036] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.546036] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: fe0f02bc-c96c-4cff-a2ef-152c3b84e79d is going to be created. [ 1044.567763] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.567763] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.567763] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.568208] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.568446] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.568761] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-fe0f02bc-c96c-4cff-a2ef-152c3b84e79d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.826043] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 in Status: SUCCESS [ 1044.826043] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.464268] env[68328]: INFO networking_nsxv3.common.synchronization [req-c8bcf6f4-11d0-4bb2-ba49-43fcaaca61dd req-f11924d4-df8b-4f20-ac89-cb0cf6052051 service nova] Enqueued Resource ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 with Priority: HIGHEST for action security_group_rules [ 1045.464268] env[68328]: INFO networking_nsxv3.common.synchronization [req-c8bcf6f4-11d0-4bb2-ba49-43fcaaca61dd req-f11924d4-df8b-4f20-ac89-cb0cf6052051 service nova] Enqueued Resource ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 with Priority: HIGHEST for action security_group_members [ 1045.464268] env[68328]: INFO networking_nsxv3.common.synchronization [req-c8bcf6f4-11d0-4bb2-ba49-43fcaaca61dd req-f11924d4-df8b-4f20-ac89-cb0cf6052051 service nova] Enqueued Resource ID: fe0f02bc-c96c-4cff-a2ef-152c3b84e79d with Priority: HIGHEST for action port [ 1045.464268] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 with Priority: HIGHEST for action security_group_rules [ 1045.464268] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 with Priority: HIGHEST for action security_group_members [ 1045.464268] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe0f02bc-c96c-4cff-a2ef-152c3b84e79d with Priority: HIGHEST for action port [ 1045.464796] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.464796] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.464796] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.464990] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.465093] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c35aa45-69e7-4952-b5d8-8a7d6b3460e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.466465] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.466622] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.466891] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe0f02bc-c96c-4cff-a2ef-152c3b84e79d taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.466989] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe0f02bc-c96c-4cff-a2ef-152c3b84e79d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.467213] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe0f02bc-c96c-4cff-a2ef-152c3b84e79d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.467401] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe0f02bc-c96c-4cff-a2ef-152c3b84e79d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.467477] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe0f02bc-c96c-4cff-a2ef-152c3b84e79d',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.833795] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 in Status: SUCCESS [ 1045.833795] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 deletion is rescheduled due to dependency. [ 1045.834036] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.834233] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.834949] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.834949] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.834949] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.834949] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.835436] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.835530] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.835758] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c35aa45-69e7-4952-b5d8-8a7d6b3460e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.877858] env[68328]: INFO networking_nsxv3.common.synchronization [req-40bdf13e-3d39-4d64-a8d0-6cd4791d9a92 req-564d04d6-49b8-4b91-bedb-c74909e065df tempest-ServerDiskConfigTestJSON-155339900 tempest-ServerDiskConfigTestJSON-155339900-project-member] Enqueued Resource ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 with Priority: HIGHEST for action security_group_members [ 1045.882859] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 with Priority: HIGHEST for action security_group_members [ 1045.883642] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-261361c9-81c8-47fa-9a8a-4e37a8a439d7 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.883911] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.884025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.884158] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.884336] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.884483] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.884553] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.884808] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.886080] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.886080] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('261361c9-81c8-47fa-9a8a-4e37a8a439d7',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.969637] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fe0f02bc-c96c-4cff-a2ef-152c3b84e79d with status ACTIVE [ 1045.969909] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.970086] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.970169] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.970410] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.970521] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.970708] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.970806] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.970867] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.971036] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.971116] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.971302] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.971392] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.971454] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.971586] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.971660] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.971752] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fe0f02bc-c96c-4cff-a2ef-152c3b84e79d is going to be updated. [ 1045.974223] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.974376] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.981602] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7acb0b1-c9e7-4016-8d0b-c700463d32e1 in Status: SUCCESS [ 1045.981803] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.981960] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.982247] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.982429] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.982530] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.982586] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.982733] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.982813] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.982895] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.982985] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d7acb0b1-c9e7-4016-8d0b-c700463d32e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.993040] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.993211] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.993283] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.993482] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.993619] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.993772] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe0f02bc-c96c-4cff-a2ef-152c3b84e79d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.338325] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7c35aa45-69e7-4952-b5d8-8a7d6b3460e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.369897] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c5088e7-0ed1-4112-b902-8fd593a8b34e in Status: SUCCESS [ 1046.370128] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c5088e7-0ed1-4112-b902-8fd593a8b34e deletion is rescheduled due to dependency. [ 1046.370206] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c5088e7-0ed1-4112-b902-8fd593a8b34e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.387285] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.387533] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.388277] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.388277] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.388277] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.389184] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.389184] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.389184] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.389184] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.389184] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.389184] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 is going to be updated. [ 1046.438157] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.438337] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.438438] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.438709] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.439030] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.448267] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 in Status: IN_PROGRESS for 2s [ 1046.484882] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.485232] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.485232] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.485477] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.485529] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.485663] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.485713] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.485829] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.485936] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.485984] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.486458] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.486458] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.486458] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.486458] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.486736] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.486736] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.486856] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.486927] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.486980] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.487064] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.487174] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d7acb0b1-c9e7-4016-8d0b-c700463d32e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.841964] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7c35aa45-69e7-4952-b5d8-8a7d6b3460e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.989744] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d7acb0b1-c9e7-4016-8d0b-c700463d32e1: rpc.has_security_group_logging(os_id): False [ 1047.011093] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.011093] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.011093] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.011093] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.011093] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.011093] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.011093] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.011093] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.011093] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.011093] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.011093] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.011093] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.011093] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.011093] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.011093] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.011812] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.011812] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.011812] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.011812] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.011812] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.011812] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d7acb0b1-c9e7-4016-8d0b-c700463d32e1 is going to be created. [ 1047.068658] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.068658] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.068658] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.068658] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.068658] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.078514] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d7acb0b1-c9e7-4016-8d0b-c700463d32e1 in Status: IN_PROGRESS for 2s [ 1047.345182] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.349180] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.349180] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.349180] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.349180] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.349180] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 is going to be updated. [ 1047.353274] env[68328]: INFO networking_nsxv3.common.synchronization [req-95bc38d2-1e04-4f03-8080-7fa0dc1d38b6 req-87eb32cf-7242-4e20-a11a-220a7e4a2410 tempest-ServerGroupTestJSON-893083902 tempest-ServerGroupTestJSON-893083902-project-member] Enqueued Resource ID: 3b0dcde5-1c71-45fa-b1b1-331b2ba39902 with Priority: HIGHEST for action security_group_members [ 1047.354206] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b0dcde5-1c71-45fa-b1b1-331b2ba39902 with Priority: HIGHEST for action security_group_members [ 1047.359366] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b0dcde5-1c71-45fa-b1b1-331b2ba39902 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.359366] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b0dcde5-1c71-45fa-b1b1-331b2ba39902" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.359366] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b0dcde5-1c71-45fa-b1b1-331b2ba39902" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.359366] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b0dcde5-1c71-45fa-b1b1-331b2ba39902" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.359366] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.359366] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.359366] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.359366] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.359366] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.359366] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b0dcde5-1c71-45fa-b1b1-331b2ba39902',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.377026] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.377026] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.377026] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.377026] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.377026] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.384159] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 in Status: IN_PROGRESS for 2s [ 1047.864538] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.864538] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.864538] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.864538] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.864538] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.864538] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.864538] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.864538] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.864538] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.864538] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.864538] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b0dcde5-1c71-45fa-b1b1-331b2ba39902 is going to be updated. [ 1047.887442] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.888317] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.890959] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.890959] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.890959] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.896871] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b0dcde5-1c71-45fa-b1b1-331b2ba39902 in Status: IN_PROGRESS for 2s [ 1048.461357] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 in Status: SUCCESS [ 1048.461643] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 deletion is rescheduled due to dependency. [ 1048.461762] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.093280] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d7acb0b1-c9e7-4016-8d0b-c700463d32e1 in Status: SUCCESS [ 1049.093280] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.395198] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 in Status: SUCCESS [ 1049.396303] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.396747] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.398156] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.398156] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.398156] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.398156] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.398156] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.398156] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.398156] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.398156] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7c35aa45-69e7-4952-b5d8-8a7d6b3460e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.901644] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.905028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.905028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.905028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.905028] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.905028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.905028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.905028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.905028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.905028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.905028] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.905028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.905028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.905028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.905028] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.905028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.905028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.905028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.905028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.906066] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.906066] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7c35aa45-69e7-4952-b5d8-8a7d6b3460e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.908661] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b0dcde5-1c71-45fa-b1b1-331b2ba39902 in Status: SUCCESS [ 1049.908661] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b0dcde5-1c71-45fa-b1b1-331b2ba39902 deletion is rescheduled due to dependency. [ 1049.908754] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b0dcde5-1c71-45fa-b1b1-331b2ba39902" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.408090] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1: rpc.has_security_group_logging(os_id): False [ 1050.425793] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.429027] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.429027] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.429027] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.429027] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.429027] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.429027] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.429027] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.429027] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.429027] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.429027] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.429027] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.429027] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.429027] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.429027] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.429770] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.429770] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.429770] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.429770] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.429956] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.430234] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 is going to be updated. [ 1050.488253] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.488401] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.488470] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.488700] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.488836] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.502155] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 in Status: IN_PROGRESS for 2s [ 1050.967232] env[68328]: INFO networking_nsxv3.common.synchronization [None req-09caee21-0b6c-4011-b153-8b1c086ce741 None None] Enqueued Resource ID: fd46f4fd-5082-4c21-8079-be9f5d37e163 with Priority: HIGHEST for action port [ 1050.967836] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd46f4fd-5082-4c21-8079-be9f5d37e163 with Priority: HIGHEST for action port [ 1050.972143] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd46f4fd-5082-4c21-8079-be9f5d37e163 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.972143] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd46f4fd-5082-4c21-8079-be9f5d37e163" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.972143] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd46f4fd-5082-4c21-8079-be9f5d37e163" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.972143] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd46f4fd-5082-4c21-8079-be9f5d37e163" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.972143] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd46f4fd-5082-4c21-8079-be9f5d37e163',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.445127] env[68328]: INFO networking_nsxv3.common.synchronization [None req-4d50d0e2-f8d3-4fc0-8158-4a9f16840168 None None] Enqueued Resource ID: 11cbdba9-19d3-4b7e-8c0c-e74093c9c0b0 with Priority: HIGHEST for action port [ 1051.448388] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11cbdba9-19d3-4b7e-8c0c-e74093c9c0b0 with Priority: HIGHEST for action port [ 1051.448388] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-11cbdba9-19d3-4b7e-8c0c-e74093c9c0b0 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.448388] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-11cbdba9-19d3-4b7e-8c0c-e74093c9c0b0" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.448388] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-11cbdba9-19d3-4b7e-8c0c-e74093c9c0b0" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.448388] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-11cbdba9-19d3-4b7e-8c0c-e74093c9c0b0" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.448388] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11cbdba9-19d3-4b7e-8c0c-e74093c9c0b0',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.471651] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fd46f4fd-5082-4c21-8079-be9f5d37e163 [ 1051.471862] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.471986] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.472067] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.472350] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.474022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.474022] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fd46f4fd-5082-4c21-8079-be9f5d37e163 already deleted. [ 1051.474022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd46f4fd-5082-4c21-8079-be9f5d37e163" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.951475] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 11cbdba9-19d3-4b7e-8c0c-e74093c9c0b0 [ 1051.951475] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.951475] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.951475] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.951475] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.951475] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.951475] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:11cbdba9-19d3-4b7e-8c0c-e74093c9c0b0 already deleted. [ 1051.951475] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-11cbdba9-19d3-4b7e-8c0c-e74093c9c0b0" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.107447] env[68328]: INFO networking_nsxv3.common.synchronization [req-36b5b74c-f20c-4716-bdd1-1858f2c05d12 req-ca9044ad-bd04-45f7-b197-e1d2ab0ebfc0 tempest-ServersTestJSON-1771388484 tempest-ServersTestJSON-1771388484-project-member] Enqueued Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_members [ 1052.110670] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_members [ 1052.111317] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-5841566c-1d05-4389-b8a7-950b5f9c6708 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.111472] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.111541] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.111796] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.112022] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.112172] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.112250] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.112457] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.112561] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.112665] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.517159] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 in Status: SUCCESS [ 1052.517159] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.534187] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-384 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.534187] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-384" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.534187] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-384" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.534187] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-384" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.534187] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.534187] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.534187] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.534588] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.534862] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.535227] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1052.535709] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1052.535952] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1052.536207] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1052.536423] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1052.536626] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1052.536860] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1052.571851] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1052.572056] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1052.572234] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1052.572449] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-384" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.572760] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-1546845f-c652-470a-a46b-d1872fd1f71f taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.572940] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-1546845f-c652-470a-a46b-d1872fd1f71f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.573267] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-1546845f-c652-470a-a46b-d1872fd1f71f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.573458] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-1546845f-c652-470a-a46b-d1872fd1f71f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.573602] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1546845f-c652-470a-a46b-d1872fd1f71f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.616221] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.082210] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.082210] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.082210] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.082210] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.082210] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.082609] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 1546845f-c652-470a-a46b-d1872fd1f71f not found, creating... [ 1053.082843] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.082907] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.083018] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.083310] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.083478] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.083911] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.084170] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.084309] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.085351] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.085351] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.085351] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 1546845f-c652-470a-a46b-d1872fd1f71f is going to be created. [ 1053.105999] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.106312] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.106460] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.107059] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.107354] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.107648] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-1546845f-c652-470a-a46b-d1872fd1f71f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.119851] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.627059] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.627582] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.627775] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.629944] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.629944] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.629944] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 is going to be updated. [ 1053.655046] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.655274] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.655395] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.655631] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.655776] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.667346] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: IN_PROGRESS for 2s [ 1053.882065] env[68328]: INFO networking_nsxv3.common.synchronization [req-36b5b74c-f20c-4716-bdd1-1858f2c05d12 req-05673594-a2a2-4152-baa3-d8b7d1b963e9 service nova] Enqueued Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_rules [ 1053.883994] env[68328]: INFO networking_nsxv3.common.synchronization [req-36b5b74c-f20c-4716-bdd1-1858f2c05d12 req-05673594-a2a2-4152-baa3-d8b7d1b963e9 service nova] Enqueued Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_members [ 1053.884461] env[68328]: INFO networking_nsxv3.common.synchronization [req-36b5b74c-f20c-4716-bdd1-1858f2c05d12 req-05673594-a2a2-4152-baa3-d8b7d1b963e9 service nova] Enqueued Resource ID: 1546845f-c652-470a-a46b-d1872fd1f71f with Priority: HIGHEST for action port [ 1053.884554] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_rules [ 1053.884728] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_members [ 1053.884804] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1546845f-c652-470a-a46b-d1872fd1f71f with Priority: HIGHEST for action port [ 1053.885936] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5841566c-1d05-4389-b8a7-950b5f9c6708 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.886545] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.886545] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.887039] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.887039] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.888366] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-5841566c-1d05-4389-b8a7-950b5f9c6708 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.889068] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.889068] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-1546845f-c652-470a-a46b-d1872fd1f71f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.889068] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1546845f-c652-470a-a46b-d1872fd1f71f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.889068] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1546845f-c652-470a-a46b-d1872fd1f71f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.891113] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1546845f-c652-470a-a46b-d1872fd1f71f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.891113] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1546845f-c652-470a-a46b-d1872fd1f71f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.037089] env[68328]: INFO networking_nsxv3.common.synchronization [None req-71689255-49ce-4579-aa9b-eb95c22710db None None] Enqueued Resource ID: 4310d656-e2ac-4854-9097-1637d9deb3ca with Priority: HIGHEST for action port [ 1054.037708] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4310d656-e2ac-4854-9097-1637d9deb3ca with Priority: HIGHEST for action port [ 1054.039108] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-4310d656-e2ac-4854-9097-1637d9deb3ca taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.039108] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4310d656-e2ac-4854-9097-1637d9deb3ca" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.039108] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4310d656-e2ac-4854-9097-1637d9deb3ca" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.039108] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4310d656-e2ac-4854-9097-1637d9deb3ca" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.039108] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4310d656-e2ac-4854-9097-1637d9deb3ca',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.335304] env[68328]: INFO networking_nsxv3.common.synchronization [None req-8e8682d6-b851-4ef3-8604-e8a938a21e06 None None] Enqueued Resource ID: 1e0f9ce4-130d-46f2-baf4-affeeddd0424 with Priority: HIGHEST for action port [ 1054.335870] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e0f9ce4-130d-46f2-baf4-affeeddd0424 with Priority: HIGHEST for action port [ 1054.338951] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e0f9ce4-130d-46f2-baf4-affeeddd0424 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.338951] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e0f9ce4-130d-46f2-baf4-affeeddd0424" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.338951] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e0f9ce4-130d-46f2-baf4-affeeddd0424" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.342791] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e0f9ce4-130d-46f2-baf4-affeeddd0424" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.342791] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e0f9ce4-130d-46f2-baf4-affeeddd0424',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.394685] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-5841566c-1d05-4389-b8a7-950b5f9c6708 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.394756] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.394942] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1546845f-c652-470a-a46b-d1872fd1f71f with status ACTIVE [ 1054.395272] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.395926] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.395926] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.395926] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.395926] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.396228] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.396228] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.396228] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.396333] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.396364] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.396536] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.396625] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.396684] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.396817] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.397085] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.397913] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1546845f-c652-470a-a46b-d1872fd1f71f is going to be updated. [ 1054.419181] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.421366] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.421366] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.421537] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.421914] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.421914] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1546845f-c652-470a-a46b-d1872fd1f71f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.540893] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4310d656-e2ac-4854-9097-1637d9deb3ca [ 1054.541114] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.541253] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.541320] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.541527] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.541617] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.541713] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4310d656-e2ac-4854-9097-1637d9deb3ca already deleted. [ 1054.541792] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4310d656-e2ac-4854-9097-1637d9deb3ca" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.843988] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1e0f9ce4-130d-46f2-baf4-affeeddd0424 [ 1054.844292] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.844399] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.844457] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.844697] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.844796] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.844900] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1e0f9ce4-130d-46f2-baf4-affeeddd0424 already deleted. [ 1054.844982] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e0f9ce4-130d-46f2-baf4-affeeddd0424" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.677518] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: SUCCESS [ 1055.677518] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.677518] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.677743] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.678192] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.678192] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.678192] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.678192] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.678192] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.678438] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.811234] env[68328]: INFO networking_nsxv3.common.synchronization [req-3bb70efb-1500-4db5-9c4d-7521b2a3100e req-12466810-1f96-4d95-8e4b-ca389bb514b2 tempest-ServerRescueTestJSON-1284245856 tempest-ServerRescueTestJSON-1284245856-project-member] Enqueued Resource ID: fdf99f09-b7da-4a5c-af72-042c6f58dc8e with Priority: HIGHEST for action security_group_members [ 1055.811738] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdf99f09-b7da-4a5c-af72-042c6f58dc8e with Priority: HIGHEST for action security_group_members [ 1055.812065] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.812225] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.812309] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.812798] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.813292] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.813292] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.813292] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.813491] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.813491] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.813491] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fdf99f09-b7da-4a5c-af72-042c6f58dc8e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.135176] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-289 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.135486] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-289" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.135532] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-289" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.135799] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-289" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.136071] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.136237] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.136360] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.136574] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.136723] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.136937] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1056.137075] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1056.137192] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1056.137307] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1056.137422] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1056.137530] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1056.137666] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1056.156318] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1056.156517] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1056.156661] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1056.156830] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-289" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.157137] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-f995c09b-8177-41eb-bb87-a66034cfe48c taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.157309] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-f995c09b-8177-41eb-bb87-a66034cfe48c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.157517] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-f995c09b-8177-41eb-bb87-a66034cfe48c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.157871] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-f995c09b-8177-41eb-bb87-a66034cfe48c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.158017] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f995c09b-8177-41eb-bb87-a66034cfe48c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.180863] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.315412] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fdf99f09-b7da-4a5c-af72-042c6f58dc8e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.660301] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.660563] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.660719] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.661072] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.661314] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.661589] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port f995c09b-8177-41eb-bb87-a66034cfe48c not found, creating... [ 1056.661888] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.662103] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.663051] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.663051] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.663051] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.663252] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.663404] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.663452] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.663674] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.663833] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.663979] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: f995c09b-8177-41eb-bb87-a66034cfe48c is going to be created. [ 1056.683866] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.686668] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.686668] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.686668] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.686932] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.687124] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.687514] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-f995c09b-8177-41eb-bb87-a66034cfe48c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.820694] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fdf99f09-b7da-4a5c-af72-042c6f58dc8e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.187874] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.188287] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.188287] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.188407] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.188459] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.188571] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 is going to be updated. [ 1057.217349] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.217349] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.217349] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.217349] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.217747] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.227969] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: IN_PROGRESS for 2s [ 1057.322730] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.322873] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.322933] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.323218] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.323348] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.323468] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdf99f09-b7da-4a5c-af72-042c6f58dc8e is going to be updated. [ 1057.351412] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.351412] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.351412] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.352716] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.352716] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.359629] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdf99f09-b7da-4a5c-af72-042c6f58dc8e in Status: IN_PROGRESS for 2s [ 1057.439918] env[68328]: INFO networking_nsxv3.common.synchronization [req-3bb70efb-1500-4db5-9c4d-7521b2a3100e req-52d6fdc7-0f03-45fc-8580-a519fff29085 service nova] Enqueued Resource ID: fdf99f09-b7da-4a5c-af72-042c6f58dc8e with Priority: HIGHEST for action security_group_rules [ 1057.440057] env[68328]: INFO networking_nsxv3.common.synchronization [req-3bb70efb-1500-4db5-9c4d-7521b2a3100e req-52d6fdc7-0f03-45fc-8580-a519fff29085 service nova] Enqueued Resource ID: fdf99f09-b7da-4a5c-af72-042c6f58dc8e with Priority: HIGHEST for action security_group_members [ 1057.440275] env[68328]: INFO networking_nsxv3.common.synchronization [req-3bb70efb-1500-4db5-9c4d-7521b2a3100e req-52d6fdc7-0f03-45fc-8580-a519fff29085 service nova] Enqueued Resource ID: f995c09b-8177-41eb-bb87-a66034cfe48c with Priority: HIGHEST for action port [ 1057.440753] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdf99f09-b7da-4a5c-af72-042c6f58dc8e with Priority: HIGHEST for action security_group_rules [ 1057.441320] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdf99f09-b7da-4a5c-af72-042c6f58dc8e with Priority: HIGHEST for action security_group_members [ 1057.441858] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f995c09b-8177-41eb-bb87-a66034cfe48c with Priority: HIGHEST for action port [ 1057.442214] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fdf99f09-b7da-4a5c-af72-042c6f58dc8e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.444289] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.444289] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.444289] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.444289] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fdf99f09-b7da-4a5c-af72-042c6f58dc8e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.444289] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.444289] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.444289] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-f995c09b-8177-41eb-bb87-a66034cfe48c taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.444289] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f995c09b-8177-41eb-bb87-a66034cfe48c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.444289] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f995c09b-8177-41eb-bb87-a66034cfe48c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.444289] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f995c09b-8177-41eb-bb87-a66034cfe48c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.444289] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f995c09b-8177-41eb-bb87-a66034cfe48c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.837121] env[68328]: INFO networking_nsxv3.common.synchronization [req-649d302f-d9ea-40a0-afc1-8dc2357a9856 req-50dbd333-e976-4b2c-b356-68aae3ebba4d tempest-ImagesTestJSON-69996350 tempest-ImagesTestJSON-69996350-project-member] Enqueued Resource ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 with Priority: HIGHEST for action security_group_members [ 1057.838604] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 with Priority: HIGHEST for action security_group_members [ 1057.839595] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-249b36cf-74ee-44d9-b2c9-d728a30d9a09 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.839595] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.839595] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.840211] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.840211] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.840370] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.840439] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.840935] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.840935] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.841065] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('249b36cf-74ee-44d9-b2c9-d728a30d9a09',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.949852] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f995c09b-8177-41eb-bb87-a66034cfe48c with status ACTIVE [ 1057.950206] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.950401] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.950765] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.950846] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.950943] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.951202] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.951353] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.951435] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.951648] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.951764] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.951995] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.952150] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.952265] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.952391] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.952496] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.952611] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f995c09b-8177-41eb-bb87-a66034cfe48c is going to be updated. [ 1057.954644] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.954644] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.974780] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.975065] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.975065] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.975733] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.976576] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.976576] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f995c09b-8177-41eb-bb87-a66034cfe48c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.344408] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.345803] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.345803] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.345803] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.345803] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.345803] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.345803] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.345803] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.346130] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.346130] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.346130] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 is going to be updated. [ 1058.372175] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.372395] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.373035] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.373035] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.373035] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.381915] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 in Status: IN_PROGRESS for 2s [ 1059.238843] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: SUCCESS [ 1059.239085] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.240024] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.240024] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.240024] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.240024] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.240024] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.240024] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.240328] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.240328] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.240448] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.370637] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdf99f09-b7da-4a5c-af72-042c6f58dc8e in Status: SUCCESS [ 1059.370637] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.370637] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.370637] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.370637] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.370637] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.370637] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.370637] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.370637] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.370637] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fdf99f09-b7da-4a5c-af72-042c6f58dc8e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.439796] env[68328]: INFO networking_nsxv3.common.synchronization [req-533f9df9-40e9-433a-bcf9-b58d90aa4316 req-14808a93-94d4-439e-9b02-389ee5a92a28 tempest-ServersTestFqdnHostnames-31007644 tempest-ServersTestFqdnHostnames-31007644-project-member] Enqueued Resource ID: b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2 with Priority: HIGHEST for action security_group_members [ 1059.440633] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2 with Priority: HIGHEST for action security_group_members [ 1059.441106] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.441357] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.441514] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.441827] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.442091] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.442280] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.442426] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.442632] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.442774] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.442921] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.744250] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-5841566c-1d05-4389-b8a7-950b5f9c6708 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.744432] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.744548] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.744816] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.745741] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.745741] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.745741] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.745741] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.745741] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.745741] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.745741] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-5841566c-1d05-4389-b8a7-950b5f9c6708 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.745741] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.746107] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.746107] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.746107] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.746214] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.746214] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.746961] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.746961] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.746961] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.746961] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.855650] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-909 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.855909] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-909" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.856022] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-909" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.856410] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-909" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.856692] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.856875] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.857143] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.857414] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.857578] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.857797] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1059.857916] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1059.858935] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1059.858935] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1059.858935] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1059.858935] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1059.858935] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1059.873554] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fdf99f09-b7da-4a5c-af72-042c6f58dc8e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.877241] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1059.877571] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1059.877729] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1059.877936] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-909" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.878283] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-75a309f6-7e1d-4597-b569-4932be416f73 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.878466] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-75a309f6-7e1d-4597-b569-4932be416f73" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.882021] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-75a309f6-7e1d-4597-b569-4932be416f73" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.882021] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-75a309f6-7e1d-4597-b569-4932be416f73" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.882021] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75a309f6-7e1d-4597-b569-4932be416f73',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.946056] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.946263] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.946413] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.946609] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.946722] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.946963] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.947097] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.947175] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.947377] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.947475] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.947582] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2 already deleted. [ 1059.947687] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.248726] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5841566c-1d05-4389-b8a7-950b5f9c6708: rpc.has_security_group_logging(os_id): False [ 1060.267503] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.271139] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.271139] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.271246] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.272049] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.272049] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.272049] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.272049] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.272049] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.272049] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.272369] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.272630] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.272630] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.272630] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.272799] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.272894] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.273087] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.273250] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.273429] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.273524] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.273616] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 is going to be updated. [ 1060.330254] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.330417] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.330458] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.330966] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.330966] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.342286] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: IN_PROGRESS for 2s [ 1060.375794] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fdf99f09-b7da-4a5c-af72-042c6f58dc8e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.385798] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.385940] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.386088] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.386390] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.386550] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.387143] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 75a309f6-7e1d-4597-b569-4932be416f73 not found, creating... [ 1060.387143] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.387346] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.387346] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.387587] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.387708] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.388387] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.388454] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.388686] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.389037] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.389295] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.389525] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 75a309f6-7e1d-4597-b569-4932be416f73 is going to be created. [ 1060.404228] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 in Status: SUCCESS [ 1060.404447] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 deletion is rescheduled due to dependency. [ 1060.404572] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.415840] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.416088] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.416231] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.416506] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.416742] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.417091] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-75a309f6-7e1d-4597-b569-4932be416f73" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.878976] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.879204] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.879204] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.879462] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.879553] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.879604] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdf99f09-b7da-4a5c-af72-042c6f58dc8e is going to be updated. [ 1060.904551] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.904727] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.904800] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.905015] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.905168] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.913679] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdf99f09-b7da-4a5c-af72-042c6f58dc8e in Status: IN_PROGRESS for 2s [ 1061.117876] env[68328]: INFO networking_nsxv3.common.synchronization [req-533f9df9-40e9-433a-bcf9-b58d90aa4316 req-8b20cf28-6e0f-487d-a499-71257e25ae13 service nova] Enqueued Resource ID: b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2 with Priority: HIGHEST for action security_group_rules [ 1061.118394] env[68328]: INFO networking_nsxv3.common.synchronization [req-533f9df9-40e9-433a-bcf9-b58d90aa4316 req-8b20cf28-6e0f-487d-a499-71257e25ae13 service nova] Enqueued Resource ID: b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2 with Priority: HIGHEST for action security_group_members [ 1061.118394] env[68328]: INFO networking_nsxv3.common.synchronization [req-533f9df9-40e9-433a-bcf9-b58d90aa4316 req-8b20cf28-6e0f-487d-a499-71257e25ae13 service nova] Enqueued Resource ID: 75a309f6-7e1d-4597-b569-4932be416f73 with Priority: HIGHEST for action port [ 1061.119214] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2 with Priority: HIGHEST for action security_group_rules [ 1061.119214] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2 with Priority: HIGHEST for action security_group_members [ 1061.119214] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75a309f6-7e1d-4597-b569-4932be416f73 with Priority: HIGHEST for action port [ 1061.119372] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.119488] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.119589] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.119881] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.119881] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.121821] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.121821] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.121821] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.121821] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.121821] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.121821] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.121821] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.121821] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.121821] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.121821] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.131077] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-75a309f6-7e1d-4597-b569-4932be416f73 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.131077] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75a309f6-7e1d-4597-b569-4932be416f73" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.131077] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75a309f6-7e1d-4597-b569-4932be416f73" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.131077] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75a309f6-7e1d-4597-b569-4932be416f73" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.131077] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75a309f6-7e1d-4597-b569-4932be416f73',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.626517] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.626924] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.626924] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.633320] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 75a309f6-7e1d-4597-b569-4932be416f73 with status ACTIVE [ 1061.633705] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.633884] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.634029] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.634339] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.634481] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.634782] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.635184] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.635184] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.635419] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.635563] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.635863] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.635995] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.636139] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.636342] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.636443] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.636551] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 75a309f6-7e1d-4597-b569-4932be416f73 is going to be updated. [ 1061.664655] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.664883] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.665033] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.665354] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.665558] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.665903] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75a309f6-7e1d-4597-b569-4932be416f73" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.093458] env[68328]: INFO networking_nsxv3.common.synchronization [req-c965f5c1-6156-4596-a372-6644bb3d57bd req-ba2eb4f0-0cbd-45a5-9663-86c865e85dc2 tempest-ServersNegativeTestJSON-1560044281 tempest-ServersNegativeTestJSON-1560044281-project-member] Enqueued Resource ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f with Priority: HIGHEST for action security_group_members [ 1062.094344] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f with Priority: HIGHEST for action security_group_members [ 1062.094764] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.094949] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.095026] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.095457] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.095457] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.095671] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.095671] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.095781] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.095866] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.095962] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0bcdd73-03e5-43ee-a623-9ac2490cee8f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.130082] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.358544] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: SUCCESS [ 1062.358764] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.560178] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-188 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.560393] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-188" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.560569] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-188" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.561788] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-188" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.561788] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.561788] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.561788] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.562066] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.562066] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.562224] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1062.562660] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1062.562808] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1062.562926] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1062.563060] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1062.563174] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1062.563317] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1062.581509] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1062.581661] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1062.585020] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1062.585020] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-188" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.585020] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-fc9472c1-b2f4-41e2-aeb7-fdac423f7ece taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.585020] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-fc9472c1-b2f4-41e2-aeb7-fdac423f7ece" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.585020] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-fc9472c1-b2f4-41e2-aeb7-fdac423f7ece" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.585020] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-fc9472c1-b2f4-41e2-aeb7-fdac423f7ece" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.585020] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc9472c1-b2f4-41e2-aeb7-fdac423f7ece',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.598665] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f0bcdd73-03e5-43ee-a623-9ac2490cee8f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.632089] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.632576] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.632576] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.632686] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.632774] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.632882] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2 is going to be created. [ 1062.654593] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.654745] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.654926] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.655218] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.655385] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.663919] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2 in Status: UNINITIALIZED for 2s [ 1062.923581] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdf99f09-b7da-4a5c-af72-042c6f58dc8e in Status: SUCCESS [ 1062.923870] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.924054] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.924271] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.924457] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.924586] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.924668] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.924817] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.924899] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.924983] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.925086] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fdf99f09-b7da-4a5c-af72-042c6f58dc8e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.086723] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.086943] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.087100] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.087406] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.087568] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.087729] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port fc9472c1-b2f4-41e2-aeb7-fdac423f7ece not found, creating... [ 1063.087997] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.088175] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.088301] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.088534] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.088679] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.088967] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.089152] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.089296] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.089517] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.089663] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.089807] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: fc9472c1-b2f4-41e2-aeb7-fdac423f7ece is going to be created. [ 1063.101254] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f0bcdd73-03e5-43ee-a623-9ac2490cee8f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.112384] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.112685] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.112866] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.113203] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.113487] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.113772] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-fc9472c1-b2f4-41e2-aeb7-fdac423f7ece" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.426865] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.427052] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.428205] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.428205] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.428205] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.428205] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.428205] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.428205] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.428205] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.428839] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.428839] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.428839] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.428839] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.428839] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.428839] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.429073] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.429073] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.429413] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.429413] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.429413] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.429413] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fdf99f09-b7da-4a5c-af72-042c6f58dc8e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.605035] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.605233] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.605330] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.605617] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.605721] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.605829] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f is going to be updated. [ 1063.633880] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.634194] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.634194] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.634339] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.634484] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.642973] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f in Status: IN_PROGRESS for 2s [ 1063.931622] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fdf99f09-b7da-4a5c-af72-042c6f58dc8e: rpc.has_security_group_logging(os_id): False [ 1063.949352] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.949592] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.949698] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.950476] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.950622] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.951192] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.951192] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.951192] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.951192] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.951575] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.951575] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.951662] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.951662] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.951861] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.951861] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.953254] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.953455] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.953603] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.953816] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.953946] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.954505] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fdf99f09-b7da-4a5c-af72-042c6f58dc8e is going to be updated. [ 1064.010736] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.010736] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.010736] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.011075] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.012102] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.023092] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fdf99f09-b7da-4a5c-af72-042c6f58dc8e in Status: IN_PROGRESS for 2s [ 1064.343390] env[68328]: INFO networking_nsxv3.common.synchronization [req-c965f5c1-6156-4596-a372-6644bb3d57bd req-a6471899-9528-45ca-868c-34236f834b80 service nova] Enqueued Resource ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f with Priority: HIGHEST for action security_group_rules [ 1064.343615] env[68328]: INFO networking_nsxv3.common.synchronization [req-c965f5c1-6156-4596-a372-6644bb3d57bd req-a6471899-9528-45ca-868c-34236f834b80 service nova] Enqueued Resource ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f with Priority: HIGHEST for action security_group_members [ 1064.343763] env[68328]: INFO networking_nsxv3.common.synchronization [req-c965f5c1-6156-4596-a372-6644bb3d57bd req-a6471899-9528-45ca-868c-34236f834b80 service nova] Enqueued Resource ID: fc9472c1-b2f4-41e2-aeb7-fdac423f7ece with Priority: HIGHEST for action port [ 1064.345979] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f with Priority: HIGHEST for action security_group_rules [ 1064.346228] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f with Priority: HIGHEST for action security_group_members [ 1064.346310] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc9472c1-b2f4-41e2-aeb7-fdac423f7ece with Priority: HIGHEST for action port [ 1064.346560] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f0bcdd73-03e5-43ee-a623-9ac2490cee8f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.346682] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.346748] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.346952] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.347050] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f0bcdd73-03e5-43ee-a623-9ac2490cee8f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.348344] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.348344] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.348344] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc9472c1-b2f4-41e2-aeb7-fdac423f7ece taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.348344] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc9472c1-b2f4-41e2-aeb7-fdac423f7ece" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.349083] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc9472c1-b2f4-41e2-aeb7-fdac423f7ece" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.349083] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc9472c1-b2f4-41e2-aeb7-fdac423f7ece" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.349083] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc9472c1-b2f4-41e2-aeb7-fdac423f7ece',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.673933] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2 in Status: SUCCESS [ 1064.674301] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.674410] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.674946] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.675093] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.675221] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.675307] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.675510] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.675610] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.675753] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.675828] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.853209] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.853387] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.857028] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fc9472c1-b2f4-41e2-aeb7-fdac423f7ece with status ACTIVE [ 1064.857266] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.857418] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.858026] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.858026] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.858026] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.858026] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.858527] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.858527] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.858527] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.858527] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.858675] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.858825] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.858874] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.858976] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.859057] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.859151] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fc9472c1-b2f4-41e2-aeb7-fdac423f7ece is going to be updated. [ 1064.879834] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.880014] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.880115] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.880319] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.880452] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.880619] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc9472c1-b2f4-41e2-aeb7-fdac423f7ece" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.180020] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.652412] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f in Status: SUCCESS [ 1065.652831] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.653155] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.653573] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.653837] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.653979] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.654063] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.654240] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.654337] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.654506] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0bcdd73-03e5-43ee-a623-9ac2490cee8f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.683260] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2: rpc.has_security_group_logging(os_id): False [ 1065.700336] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.700485] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.700556] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.703032] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.703032] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.703032] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.703032] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.703032] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.703032] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.703032] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.703032] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2 is going to be created. [ 1065.755591] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.755591] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.755591] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.755591] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.755591] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.765951] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2 in Status: IN_PROGRESS for 2s [ 1066.036103] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fdf99f09-b7da-4a5c-af72-042c6f58dc8e in Status: SUCCESS [ 1066.036355] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.157660] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f0bcdd73-03e5-43ee-a623-9ac2490cee8f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.660241] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f0bcdd73-03e5-43ee-a623-9ac2490cee8f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.898809] env[68328]: INFO networking_nsxv3.common.synchronization [req-723590fb-988a-412d-b4fc-ad4952c1815b req-1cae4b77-685c-491d-abc0-99a568b4df18 tempest-ServersTestJSON-1771388484 tempest-ServersTestJSON-1771388484-project-member] Enqueued Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_members [ 1066.899421] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_members [ 1066.899774] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-5841566c-1d05-4389-b8a7-950b5f9c6708 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.899927] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.900050] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.900296] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.900484] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.900586] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.900675] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.900845] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.900946] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.901070] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.164383] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.164578] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.164707] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.164923] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.165123] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.165123] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f is going to be updated. [ 1067.191313] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.191531] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.191611] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.191838] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.192083] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.201747] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f in Status: IN_PROGRESS for 2s [ 1067.405298] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.777015] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2 in Status: SUCCESS [ 1067.777228] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.907134] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.411768] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.411956] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.412047] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.412282] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.412469] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.412656] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 is going to be updated. [ 1068.438233] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.438415] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.438481] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.438689] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.438841] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.447485] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: IN_PROGRESS for 2s [ 1069.215841] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f in Status: SUCCESS [ 1069.217503] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.217656] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.217897] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.218120] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.218242] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.218308] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.218477] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.218561] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.218646] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.218736] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f0bcdd73-03e5-43ee-a623-9ac2490cee8f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.670405] env[68328]: INFO networking_nsxv3.common.synchronization [req-110c5090-6eda-499d-b9fc-e3fd9005b039 req-2fbeedf6-2517-4a0f-9b86-4054b9a6b79b tempest-ServerDiskConfigTestJSON-155339900 tempest-ServerDiskConfigTestJSON-155339900-project-member] Enqueued Resource ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 with Priority: HIGHEST for action security_group_members [ 1069.670937] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 with Priority: HIGHEST for action security_group_members [ 1069.671312] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-261361c9-81c8-47fa-9a8a-4e37a8a439d7 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.671409] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.671453] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.671659] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.671806] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.671900] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.671961] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.672221] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.672380] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.672497] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('261361c9-81c8-47fa-9a8a-4e37a8a439d7',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.724766] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.724766] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.724766] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.725041] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.725309] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.725460] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.725614] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.725805] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.725935] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.726085] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.726847] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.726847] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.726847] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.726847] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.726847] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.727170] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.727170] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.727170] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.727311] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.727311] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.727451] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f0bcdd73-03e5-43ee-a623-9ac2490cee8f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.060956] env[68328]: INFO networking_nsxv3.common.synchronization [None req-15bebb90-98ff-4c4e-8461-d1d5f3effc8e tempest-AttachInterfacesTestJSON-966841523 tempest-AttachInterfacesTestJSON-966841523-project-member] Enqueued Resource ID: e27762cf-c0f5-443d-8332-584b8241d0be with Priority: HIGHEST for action security_group_rules [ 1070.061820] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e27762cf-c0f5-443d-8332-584b8241d0be with Priority: HIGHEST for action security_group_rules [ 1070.062337] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e27762cf-c0f5-443d-8332-584b8241d0be taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.064138] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e27762cf-c0f5-443d-8332-584b8241d0be" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.064138] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e27762cf-c0f5-443d-8332-584b8241d0be" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.064138] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e27762cf-c0f5-443d-8332-584b8241d0be" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.064138] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e27762cf-c0f5-443d-8332-584b8241d0be',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.175713] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.175988] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.176282] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.176563] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.176704] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.176923] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.177040] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.177104] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.177265] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.177342] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.177429] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 is going to be updated. [ 1070.180521] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-754 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.180644] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-754" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.181223] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-754" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.181563] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-754" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.181978] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.182297] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.182398] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.182701] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.182868] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.185160] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1070.185160] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1070.185160] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1070.185431] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1070.185431] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1070.185612] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1070.188052] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1070.212922] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1070.213218] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1070.213429] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1070.213685] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-754" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.214161] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-cecf4e35-48f8-468b-ad5b-48cf21b6902c taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.214414] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-cecf4e35-48f8-468b-ad5b-48cf21b6902c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.214596] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-cecf4e35-48f8-468b-ad5b-48cf21b6902c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.217739] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-cecf4e35-48f8-468b-ad5b-48cf21b6902c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.219205] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cecf4e35-48f8-468b-ad5b-48cf21b6902c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.221716] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.221887] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.221970] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.223773] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.223773] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.230776] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f0bcdd73-03e5-43ee-a623-9ac2490cee8f: rpc.has_security_group_logging(os_id): False [ 1070.235761] env[68328]: INFO networking_nsxv3.common.synchronization [None req-dc52cf22-106c-485d-897c-ca1ec6e7c4fd tempest-AttachInterfacesTestJSON-966841523 tempest-AttachInterfacesTestJSON-966841523-project-member] Enqueued Resource ID: e27762cf-c0f5-443d-8332-584b8241d0be with Priority: HIGHEST for action security_group_rules [ 1070.237074] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 in Status: IN_PROGRESS for 2s [ 1070.239086] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e27762cf-c0f5-443d-8332-584b8241d0be with Priority: HIGHEST for action security_group_rules [ 1070.239086] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e27762cf-c0f5-443d-8332-584b8241d0be taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.239086] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e27762cf-c0f5-443d-8332-584b8241d0be" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.255310] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.255443] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.255788] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.255788] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.255924] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.256620] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.256620] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.256620] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.256620] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.256620] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.256931] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.256931] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.256931] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.256931] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.257080] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.257663] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.257663] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.257663] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.257663] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.257663] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.257663] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f is going to be updated. [ 1070.342808] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.343023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.343023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.343226] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.343396] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.360025] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f in Status: IN_PROGRESS for 2s [ 1070.457376] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: SUCCESS [ 1070.457851] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.583682] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.583682] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.583682] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.583899] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.583899] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.583965] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e27762cf-c0f5-443d-8332-584b8241d0be already deleted. [ 1070.583999] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e27762cf-c0f5-443d-8332-584b8241d0be" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.584164] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e27762cf-c0f5-443d-8332-584b8241d0be" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.584315] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e27762cf-c0f5-443d-8332-584b8241d0be" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.584397] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e27762cf-c0f5-443d-8332-584b8241d0be',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.726553] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.726885] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.727062] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.727354] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.727538] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.727694] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port cecf4e35-48f8-468b-ad5b-48cf21b6902c not found, creating... [ 1070.728033] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.728212] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.728339] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.728615] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.728814] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.729139] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.729351] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.729523] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.729764] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.729908] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.730105] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: cecf4e35-48f8-468b-ad5b-48cf21b6902c is going to be created. [ 1070.748779] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.749060] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.749185] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.749537] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.749810] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.750064] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-cecf4e35-48f8-468b-ad5b-48cf21b6902c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.104915] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.104915] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.104915] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.105278] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.105438] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.105613] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e27762cf-c0f5-443d-8332-584b8241d0be already deleted. [ 1071.109025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e27762cf-c0f5-443d-8332-584b8241d0be" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.669718] env[68328]: INFO networking_nsxv3.common.synchronization [req-110c5090-6eda-499d-b9fc-e3fd9005b039 req-4fb99312-833a-419b-982d-2b70d6f0348f service nova] Enqueued Resource ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 with Priority: HIGHEST for action security_group_rules [ 1071.670035] env[68328]: INFO networking_nsxv3.common.synchronization [req-110c5090-6eda-499d-b9fc-e3fd9005b039 req-4fb99312-833a-419b-982d-2b70d6f0348f service nova] Enqueued Resource ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 with Priority: HIGHEST for action security_group_members [ 1071.670267] env[68328]: INFO networking_nsxv3.common.synchronization [req-110c5090-6eda-499d-b9fc-e3fd9005b039 req-4fb99312-833a-419b-982d-2b70d6f0348f service nova] Enqueued Resource ID: cecf4e35-48f8-468b-ad5b-48cf21b6902c with Priority: HIGHEST for action port [ 1071.671021] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 with Priority: HIGHEST for action security_group_rules [ 1071.672030] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 with Priority: HIGHEST for action security_group_members [ 1071.672030] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cecf4e35-48f8-468b-ad5b-48cf21b6902c with Priority: HIGHEST for action port [ 1071.672030] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-261361c9-81c8-47fa-9a8a-4e37a8a439d7 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.672030] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.672758] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.672758] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.672758] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('261361c9-81c8-47fa-9a8a-4e37a8a439d7',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.673750] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-261361c9-81c8-47fa-9a8a-4e37a8a439d7 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.673889] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.674216] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-cecf4e35-48f8-468b-ad5b-48cf21b6902c taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.674429] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cecf4e35-48f8-468b-ad5b-48cf21b6902c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.674496] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cecf4e35-48f8-468b-ad5b-48cf21b6902c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.674807] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cecf4e35-48f8-468b-ad5b-48cf21b6902c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.674807] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cecf4e35-48f8-468b-ad5b-48cf21b6902c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.111257] env[68328]: INFO networking_nsxv3.common.synchronization [req-9ce60351-c59a-4f67-b97f-e37e6f5f3697 req-f3f19458-5d78-4311-bd19-94eee5f0ca27 tempest-ServerActionsTestOtherA-501294167 tempest-ServerActionsTestOtherA-501294167-project-member] Enqueued Resource ID: d7acb0b1-c9e7-4016-8d0b-c700463d32e1 with Priority: HIGHEST for action security_group_members [ 1072.111891] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7acb0b1-c9e7-4016-8d0b-c700463d32e1 with Priority: HIGHEST for action security_group_members [ 1072.115865] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.115865] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.115865] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.116321] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.116321] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.116321] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.116447] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.116542] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.116604] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.116705] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7acb0b1-c9e7-4016-8d0b-c700463d32e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.180500] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-261361c9-81c8-47fa-9a8a-4e37a8a439d7 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.184376] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.184376] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cecf4e35-48f8-468b-ad5b-48cf21b6902c with status ACTIVE [ 1072.184376] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.184376] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.184376] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.184376] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.184376] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.184376] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.184376] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.184376] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.184376] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.184376] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.184376] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.184376] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.184376] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.184376] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.189276] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.189276] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cecf4e35-48f8-468b-ad5b-48cf21b6902c is going to be updated. [ 1072.209561] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.209768] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.209839] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.210166] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.210840] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.210840] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cecf4e35-48f8-468b-ad5b-48cf21b6902c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.251577] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 in Status: SUCCESS [ 1072.251856] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 deletion is rescheduled due to dependency. [ 1072.252080] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.252253] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.252621] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.252896] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.253095] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.253254] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.253473] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.253564] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.253668] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('261361c9-81c8-47fa-9a8a-4e37a8a439d7',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.370494] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f in Status: SUCCESS [ 1072.370494] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.622727] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.622916] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.622998] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.623185] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.623264] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.623506] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.623614] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.623685] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.623815] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.623885] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.623968] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7acb0b1-c9e7-4016-8d0b-c700463d32e1 is going to be updated. [ 1072.648715] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.648869] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.648941] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.649179] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.649324] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.657762] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7acb0b1-c9e7-4016-8d0b-c700463d32e1 in Status: IN_PROGRESS for 2s [ 1072.759723] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('261361c9-81c8-47fa-9a8a-4e37a8a439d7',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.995871] env[68328]: INFO networking_nsxv3.common.synchronization [req-961297e8-240b-4109-8c3a-9470ffab69a7 req-93477d85-bef5-492d-9d1b-6ea207351451 tempest-ServerMetadataTestJSON-1827292363 tempest-ServerMetadataTestJSON-1827292363-project-member] Enqueued Resource ID: 4607d7c6-d635-4a5a-9767-6150fed7c420 with Priority: HIGHEST for action security_group_members [ 1072.996419] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4607d7c6-d635-4a5a-9767-6150fed7c420 with Priority: HIGHEST for action security_group_members [ 1072.996729] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-4607d7c6-d635-4a5a-9767-6150fed7c420 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.997253] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4607d7c6-d635-4a5a-9767-6150fed7c420" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.997253] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4607d7c6-d635-4a5a-9767-6150fed7c420" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.997654] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4607d7c6-d635-4a5a-9767-6150fed7c420" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.998248] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.998840] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.998956] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.999184] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.999324] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.999615] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4607d7c6-d635-4a5a-9767-6150fed7c420',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.262471] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('261361c9-81c8-47fa-9a8a-4e37a8a439d7',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.484727] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-533 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.484955] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-533" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.485127] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-533" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.485501] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-533" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.485806] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.485989] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.486158] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.486437] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.486644] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.486941] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1073.487107] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1073.487246] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1073.487385] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1073.487520] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1073.489067] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1073.489067] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1073.507135] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.507135] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.507135] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.507135] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.507135] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.507135] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.507135] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.507135] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.507135] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.507135] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.507135] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4607d7c6-d635-4a5a-9767-6150fed7c420 already deleted. [ 1073.507135] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4607d7c6-d635-4a5a-9767-6150fed7c420" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.507892] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1073.508037] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1073.508199] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1073.508416] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-533" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.508749] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-78aae7a7-2ad3-4e6f-89c1-edfbfdef713e taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.508931] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-78aae7a7-2ad3-4e6f-89c1-edfbfdef713e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.509130] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-78aae7a7-2ad3-4e6f-89c1-edfbfdef713e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.509424] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-78aae7a7-2ad3-4e6f-89c1-edfbfdef713e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.509562] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78aae7a7-2ad3-4e6f-89c1-edfbfdef713e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.765045] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.765328] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.765328] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.765502] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.765554] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.765661] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 is going to be updated. [ 1073.792652] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.795132] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.795132] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.795132] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.795132] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.801322] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 in Status: IN_PROGRESS for 2s [ 1074.017367] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.017367] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.017367] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.017624] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.017733] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.017958] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 78aae7a7-2ad3-4e6f-89c1-edfbfdef713e not found, creating... [ 1074.018413] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.018629] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.018859] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.019172] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.019400] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.019861] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.020089] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.020269] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.020575] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.020818] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.021062] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 78aae7a7-2ad3-4e6f-89c1-edfbfdef713e is going to be created. [ 1074.039928] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.040263] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.040469] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.040874] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.041245] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.041582] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-78aae7a7-2ad3-4e6f-89c1-edfbfdef713e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.669312] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7acb0b1-c9e7-4016-8d0b-c700463d32e1 in Status: SUCCESS [ 1074.669672] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7acb0b1-c9e7-4016-8d0b-c700463d32e1 deletion is rescheduled due to dependency. [ 1074.669974] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.175938] env[68328]: INFO networking_nsxv3.common.synchronization [req-961297e8-240b-4109-8c3a-9470ffab69a7 req-5fed03a7-5fda-4875-b0ca-13b3e2849134 service nova] Enqueued Resource ID: 4607d7c6-d635-4a5a-9767-6150fed7c420 with Priority: HIGHEST for action security_group_rules [ 1075.177224] env[68328]: INFO networking_nsxv3.common.synchronization [req-961297e8-240b-4109-8c3a-9470ffab69a7 req-5fed03a7-5fda-4875-b0ca-13b3e2849134 service nova] Enqueued Resource ID: 4607d7c6-d635-4a5a-9767-6150fed7c420 with Priority: HIGHEST for action security_group_members [ 1075.177224] env[68328]: INFO networking_nsxv3.common.synchronization [req-961297e8-240b-4109-8c3a-9470ffab69a7 req-5fed03a7-5fda-4875-b0ca-13b3e2849134 service nova] Enqueued Resource ID: 78aae7a7-2ad3-4e6f-89c1-edfbfdef713e with Priority: HIGHEST for action port [ 1075.180387] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4607d7c6-d635-4a5a-9767-6150fed7c420 with Priority: HIGHEST for action security_group_rules [ 1075.180503] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4607d7c6-d635-4a5a-9767-6150fed7c420 with Priority: HIGHEST for action security_group_members [ 1075.180654] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78aae7a7-2ad3-4e6f-89c1-edfbfdef713e with Priority: HIGHEST for action port [ 1075.181808] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4607d7c6-d635-4a5a-9767-6150fed7c420 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.181973] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4607d7c6-d635-4a5a-9767-6150fed7c420" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.182086] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4607d7c6-d635-4a5a-9767-6150fed7c420" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.182422] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4607d7c6-d635-4a5a-9767-6150fed7c420" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.182538] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4607d7c6-d635-4a5a-9767-6150fed7c420',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.183618] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-4607d7c6-d635-4a5a-9767-6150fed7c420 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.183765] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4607d7c6-d635-4a5a-9767-6150fed7c420" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.183859] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4607d7c6-d635-4a5a-9767-6150fed7c420" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.187313] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4607d7c6-d635-4a5a-9767-6150fed7c420" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.190101] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.190101] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.190101] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.190101] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.190101] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.190101] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4607d7c6-d635-4a5a-9767-6150fed7c420',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.190101] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-78aae7a7-2ad3-4e6f-89c1-edfbfdef713e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.190101] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-78aae7a7-2ad3-4e6f-89c1-edfbfdef713e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.190698] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-78aae7a7-2ad3-4e6f-89c1-edfbfdef713e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.190698] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-78aae7a7-2ad3-4e6f-89c1-edfbfdef713e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.190698] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78aae7a7-2ad3-4e6f-89c1-edfbfdef713e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.194295] env[68328]: INFO networking_nsxv3.common.synchronization [req-0d5cfcc1-157c-4430-8df6-463cc9475d05 req-3239f8ea-6e1f-4fa0-ad29-4b5a1817ae16 tempest-InstanceActionsNegativeTestJSON-795141991 tempest-InstanceActionsNegativeTestJSON-795141991-project-member] Enqueued Resource ID: 378c3841-8f36-4e7a-8646-033f27e348d9 with Priority: HIGHEST for action security_group_members [ 1075.194710] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 378c3841-8f36-4e7a-8646-033f27e348d9 with Priority: HIGHEST for action security_group_members [ 1075.194991] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-378c3841-8f36-4e7a-8646-033f27e348d9 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.195127] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-378c3841-8f36-4e7a-8646-033f27e348d9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.195388] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-378c3841-8f36-4e7a-8646-033f27e348d9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.195388] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-378c3841-8f36-4e7a-8646-033f27e348d9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.195515] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.195604] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.195660] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.195796] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.195872] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.195953] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('378c3841-8f36-4e7a-8646-033f27e348d9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.311020] env[68328]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-038e1d26-3718-4954-be87-7b533345599d None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1075.311020] env[68328]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-038e1d26-3718-4954-be87-7b533345599d None None] NSXv3 Agent Agent loop - iteration:2 started [ 1075.614506] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-385 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.614740] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-385" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.614930] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-385" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.615334] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-385" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.617393] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.617571] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.617702] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.617964] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.618148] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.618369] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1075.618764] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1075.618877] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1075.619105] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1075.619213] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1075.619324] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1075.619487] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1075.640013] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1075.640298] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1075.640463] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1075.640649] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-385" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.641652] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-aa447457-9110-424f-bd7c-38b00cf398c4 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.641837] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-aa447457-9110-424f-bd7c-38b00cf398c4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.641968] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-aa447457-9110-424f-bd7c-38b00cf398c4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.642294] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-aa447457-9110-424f-bd7c-38b00cf398c4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.642464] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa447457-9110-424f-bd7c-38b00cf398c4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.659827] env[68328]: INFO networking_nsxv3.common.synchronization [req-ca8bdd92-3bac-4e3c-8f1d-7256990be818 req-8616bd9a-3a6a-4eea-b3cd-c846ed19a663 tempest-ServersNegativeTestJSON-1560044281 tempest-ServersNegativeTestJSON-1560044281-project-member] Enqueued Resource ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f with Priority: HIGHEST for action security_group_members [ 1075.660948] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f with Priority: HIGHEST for action security_group_members [ 1075.661164] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.661291] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.661370] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.661956] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.662130] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.662238] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.662293] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.662551] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.662645] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.662744] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0bcdd73-03e5-43ee-a623-9ac2490cee8f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.693907] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-4607d7c6-d635-4a5a-9767-6150fed7c420 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.693907] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4607d7c6-d635-4a5a-9767-6150fed7c420" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.694364] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4607d7c6-d635-4a5a-9767-6150fed7c420',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.700755] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.700873] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.700944] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.701266] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.701266] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.701466] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.701572] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.701643] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.701797] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.701899] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.701958] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 378c3841-8f36-4e7a-8646-033f27e348d9 already deleted. [ 1075.702048] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-378c3841-8f36-4e7a-8646-033f27e348d9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.702240] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 78aae7a7-2ad3-4e6f-89c1-edfbfdef713e with status ACTIVE [ 1075.702388] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.702515] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.702560] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.702721] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.702758] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.702914] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.703018] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.703072] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.703205] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.703278] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.703465] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.703900] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.703900] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.703900] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.703900] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.703900] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 78aae7a7-2ad3-4e6f-89c1-edfbfdef713e is going to be updated. [ 1075.741650] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.741799] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.742054] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.742126] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.742231] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.742392] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-78aae7a7-2ad3-4e6f-89c1-edfbfdef713e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.810806] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 in Status: SUCCESS [ 1075.811102] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.811322] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.811573] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.811795] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.811932] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.812030] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.812218] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.812324] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.812569] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.812670] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('261361c9-81c8-47fa-9a8a-4e37a8a439d7',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.145566] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.145825] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.145958] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.146261] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.146420] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.146581] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port aa447457-9110-424f-bd7c-38b00cf398c4 not found, creating... [ 1076.146842] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.147008] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.147148] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.147380] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.147524] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.147807] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.147963] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.151225] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.151472] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.151619] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.151768] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: aa447457-9110-424f-bd7c-38b00cf398c4 is going to be created. [ 1076.167836] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f0bcdd73-03e5-43ee-a623-9ac2490cee8f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.171760] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.171945] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.172092] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.172352] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.172622] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.173112] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-aa447457-9110-424f-bd7c-38b00cf398c4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.197031] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4607d7c6-d635-4a5a-9767-6150fed7c420',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.315420] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-261361c9-81c8-47fa-9a8a-4e37a8a439d7 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.315570] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.315643] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.315895] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.316084] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.316198] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.316267] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.316427] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.316511] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.316602] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.316760] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-261361c9-81c8-47fa-9a8a-4e37a8a439d7 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.316854] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.316913] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.317069] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.317204] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.317290] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.317347] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.317493] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.317562] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.317639] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.317726] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('261361c9-81c8-47fa-9a8a-4e37a8a439d7',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.674298] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f0bcdd73-03e5-43ee-a623-9ac2490cee8f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.700455] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.700596] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.700671] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.700886] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.700979] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.701092] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4607d7c6-d635-4a5a-9767-6150fed7c420 is going to be created. [ 1076.725956] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.726137] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.726202] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.726409] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.726571] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.735746] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4607d7c6-d635-4a5a-9767-6150fed7c420 in Status: UNINITIALIZED for 2s [ 1076.820801] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 261361c9-81c8-47fa-9a8a-4e37a8a439d7: rpc.has_security_group_logging(os_id): False [ 1076.842205] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.842392] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.842495] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.842844] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.842844] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.843087] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.843197] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.843266] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.843566] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.843566] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.843693] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.843788] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.843887] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.844016] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.844093] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.844282] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.844374] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.844430] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.844569] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.844638] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.844726] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 is going to be updated. [ 1076.904276] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.904780] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.904877] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.905124] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.905276] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.922318] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 in Status: IN_PROGRESS for 2s [ 1077.176986] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.176986] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.176986] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.176986] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.176986] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.177492] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f is going to be updated. [ 1077.205615] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.206048] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.206048] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.206048] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.206180] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.216475] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f in Status: IN_PROGRESS for 2s [ 1077.387975] env[68328]: INFO networking_nsxv3.common.synchronization [req-0d5cfcc1-157c-4430-8df6-463cc9475d05 req-5abe9666-bca9-4820-997a-9f58b213129d service nova] Enqueued Resource ID: 378c3841-8f36-4e7a-8646-033f27e348d9 with Priority: HIGHEST for action security_group_rules [ 1077.388178] env[68328]: INFO networking_nsxv3.common.synchronization [req-0d5cfcc1-157c-4430-8df6-463cc9475d05 req-5abe9666-bca9-4820-997a-9f58b213129d service nova] Enqueued Resource ID: 378c3841-8f36-4e7a-8646-033f27e348d9 with Priority: HIGHEST for action security_group_members [ 1077.388327] env[68328]: INFO networking_nsxv3.common.synchronization [req-0d5cfcc1-157c-4430-8df6-463cc9475d05 req-5abe9666-bca9-4820-997a-9f58b213129d service nova] Enqueued Resource ID: aa447457-9110-424f-bd7c-38b00cf398c4 with Priority: HIGHEST for action port [ 1077.388832] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 378c3841-8f36-4e7a-8646-033f27e348d9 with Priority: HIGHEST for action security_group_rules [ 1077.389019] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 378c3841-8f36-4e7a-8646-033f27e348d9 with Priority: HIGHEST for action security_group_members [ 1077.390048] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa447457-9110-424f-bd7c-38b00cf398c4 with Priority: HIGHEST for action port [ 1077.390048] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-378c3841-8f36-4e7a-8646-033f27e348d9 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.390048] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-378c3841-8f36-4e7a-8646-033f27e348d9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.390048] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-378c3841-8f36-4e7a-8646-033f27e348d9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.390313] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-378c3841-8f36-4e7a-8646-033f27e348d9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.390313] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('378c3841-8f36-4e7a-8646-033f27e348d9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.391129] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-378c3841-8f36-4e7a-8646-033f27e348d9 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.391237] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-378c3841-8f36-4e7a-8646-033f27e348d9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.391237] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-378c3841-8f36-4e7a-8646-033f27e348d9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.391423] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-378c3841-8f36-4e7a-8646-033f27e348d9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.391919] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.391919] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.391919] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.391919] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.391919] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.392417] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('378c3841-8f36-4e7a-8646-033f27e348d9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.392868] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa447457-9110-424f-bd7c-38b00cf398c4 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.392868] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa447457-9110-424f-bd7c-38b00cf398c4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.393150] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa447457-9110-424f-bd7c-38b00cf398c4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.397089] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa447457-9110-424f-bd7c-38b00cf398c4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.397089] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa447457-9110-424f-bd7c-38b00cf398c4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.705358] env[68328]: INFO networking_nsxv3.common.synchronization [req-e15d1cb9-6ca6-48ad-a69a-5714cd7b0fca req-ff7234ac-d4b4-401d-b6f5-7ceedceb39da tempest-ServerActionsTestJSON-719988657 tempest-ServerActionsTestJSON-719988657-project-member] Enqueued Resource ID: 57513254-a6e5-4b1e-87b8-b529d35f4b6b with Priority: HIGHEST for action security_group_members [ 1077.706515] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57513254-a6e5-4b1e-87b8-b529d35f4b6b with Priority: HIGHEST for action security_group_members [ 1077.706921] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-57513254-a6e5-4b1e-87b8-b529d35f4b6b taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.707101] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57513254-a6e5-4b1e-87b8-b529d35f4b6b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.707212] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57513254-a6e5-4b1e-87b8-b529d35f4b6b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.707529] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57513254-a6e5-4b1e-87b8-b529d35f4b6b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.707731] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.707889] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.707992] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.708214] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.708214] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.708214] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57513254-a6e5-4b1e-87b8-b529d35f4b6b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.896499] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-378c3841-8f36-4e7a-8646-033f27e348d9 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.896636] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-378c3841-8f36-4e7a-8646-033f27e348d9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.897198] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('378c3841-8f36-4e7a-8646-033f27e348d9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.900665] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aa447457-9110-424f-bd7c-38b00cf398c4 with status ACTIVE [ 1077.900665] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.900665] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.900665] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.900991] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.900991] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.901507] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.901507] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.901507] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.901936] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.901936] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.902123] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.902287] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.902373] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.902909] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.902909] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.902909] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aa447457-9110-424f-bd7c-38b00cf398c4 is going to be updated. [ 1077.926436] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.926589] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.926645] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.927304] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.927463] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.927650] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa447457-9110-424f-bd7c-38b00cf398c4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.210672] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.210995] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.210995] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.211183] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.234476] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.235177] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.235416] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.235497] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.235846] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.235947] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.236059] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57513254-a6e5-4b1e-87b8-b529d35f4b6b is going to be updated. [ 1078.268807] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.268959] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.269030] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.269257] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.269408] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.277623] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57513254-a6e5-4b1e-87b8-b529d35f4b6b in Status: IN_PROGRESS for 2s [ 1078.409678] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('378c3841-8f36-4e7a-8646-033f27e348d9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.745811] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4607d7c6-d635-4a5a-9767-6150fed7c420 in Status: SUCCESS [ 1078.745811] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4607d7c6-d635-4a5a-9767-6150fed7c420" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.745811] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4607d7c6-d635-4a5a-9767-6150fed7c420" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.745811] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4607d7c6-d635-4a5a-9767-6150fed7c420" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.746089] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.746089] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.746089] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.746247] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.746284] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.746341] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4607d7c6-d635-4a5a-9767-6150fed7c420" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.746428] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4607d7c6-d635-4a5a-9767-6150fed7c420',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.912101] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.912353] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.912458] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.913172] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.913172] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.913172] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 378c3841-8f36-4e7a-8646-033f27e348d9 is going to be created. [ 1078.937894] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 in Status: SUCCESS [ 1078.938230] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.941313] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.941510] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.941510] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.941773] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.941945] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.952225] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 378c3841-8f36-4e7a-8646-033f27e348d9 in Status: UNINITIALIZED for 2s [ 1079.228756] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f in Status: SUCCESS [ 1079.229086] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.249339] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-4607d7c6-d635-4a5a-9767-6150fed7c420 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.249480] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4607d7c6-d635-4a5a-9767-6150fed7c420" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.249528] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4607d7c6-d635-4a5a-9767-6150fed7c420" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.249736] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4607d7c6-d635-4a5a-9767-6150fed7c420" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.249899] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.250053] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.250129] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.250249] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.250356] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.250415] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4607d7c6-d635-4a5a-9767-6150fed7c420" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.250566] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-4607d7c6-d635-4a5a-9767-6150fed7c420 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.250663] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4607d7c6-d635-4a5a-9767-6150fed7c420" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.250722] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4607d7c6-d635-4a5a-9767-6150fed7c420" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.250860] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4607d7c6-d635-4a5a-9767-6150fed7c420" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.251050] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.251135] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.251135] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.251263] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.251343] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.251415] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4607d7c6-d635-4a5a-9767-6150fed7c420" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.251509] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4607d7c6-d635-4a5a-9767-6150fed7c420',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.754281] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4607d7c6-d635-4a5a-9767-6150fed7c420: rpc.has_security_group_logging(os_id): False [ 1079.778021] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.778021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.778021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.778021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.778021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.778319] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.778319] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.778407] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.778575] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.778645] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.778850] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.779025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.779025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.779199] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.779688] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.779688] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.779688] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.779688] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.779854] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.779944] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.780012] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4607d7c6-d635-4a5a-9767-6150fed7c420 is going to be created. [ 1079.840756] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.841146] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.841146] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.841743] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.841743] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.852724] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4607d7c6-d635-4a5a-9767-6150fed7c420 in Status: IN_PROGRESS for 2s [ 1080.290017] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57513254-a6e5-4b1e-87b8-b529d35f4b6b in Status: SUCCESS [ 1080.290017] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57513254-a6e5-4b1e-87b8-b529d35f4b6b deletion is rescheduled due to dependency. [ 1080.290017] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57513254-a6e5-4b1e-87b8-b529d35f4b6b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.348792] env[68328]: INFO networking_nsxv3.common.synchronization [req-479233b2-1ff8-423f-bcaa-25a2195739e5 req-ee32d729-bc3e-4f59-b044-aff5f6207411 tempest-AttachInterfacesTestJSON-966841523 tempest-AttachInterfacesTestJSON-966841523-project-member] Enqueued Resource ID: e27762cf-c0f5-443d-8332-584b8241d0be with Priority: HIGHEST for action security_group_members [ 1080.349419] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e27762cf-c0f5-443d-8332-584b8241d0be with Priority: HIGHEST for action security_group_members [ 1080.349740] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-e27762cf-c0f5-443d-8332-584b8241d0be taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.349862] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e27762cf-c0f5-443d-8332-584b8241d0be" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.349921] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e27762cf-c0f5-443d-8332-584b8241d0be" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.350192] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e27762cf-c0f5-443d-8332-584b8241d0be" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.350545] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.350892] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.350962] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.351300] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.351300] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.351404] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e27762cf-c0f5-443d-8332-584b8241d0be',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.664753] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-615 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.664753] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-615" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.664753] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-615" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.664753] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-615" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.664753] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.664753] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.664753] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.664753] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.664753] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.664753] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1080.664753] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1080.664753] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1080.664753] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1080.667811] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1080.667811] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1080.667811] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1080.679562] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1080.680374] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1080.680374] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1080.680374] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-615" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.681198] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-46e16a0e-38cf-4f16-954a-d300d8afa949 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.681198] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-46e16a0e-38cf-4f16-954a-d300d8afa949" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.681325] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-46e16a0e-38cf-4f16-954a-d300d8afa949" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.681798] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-46e16a0e-38cf-4f16-954a-d300d8afa949" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.682042] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46e16a0e-38cf-4f16-954a-d300d8afa949',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.854393] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.854393] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.854393] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.854589] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.854657] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.854872] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.854976] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.855051] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.855217] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.855297] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.855402] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e27762cf-c0f5-443d-8332-584b8241d0be already deleted. [ 1080.855483] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e27762cf-c0f5-443d-8332-584b8241d0be" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.963061] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 378c3841-8f36-4e7a-8646-033f27e348d9 in Status: SUCCESS [ 1080.963061] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-378c3841-8f36-4e7a-8646-033f27e348d9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.963061] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-378c3841-8f36-4e7a-8646-033f27e348d9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.963061] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-378c3841-8f36-4e7a-8646-033f27e348d9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.963061] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.963061] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.963061] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.963364] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.963364] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.963364] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-378c3841-8f36-4e7a-8646-033f27e348d9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.963430] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('378c3841-8f36-4e7a-8646-033f27e348d9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.185848] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.186073] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.186197] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.186486] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.186650] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.186812] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 46e16a0e-38cf-4f16-954a-d300d8afa949 not found, creating... [ 1081.187104] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.187272] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.187393] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.187618] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.187782] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.188063] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.188226] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.188346] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.188557] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.188697] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.188841] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 46e16a0e-38cf-4f16-954a-d300d8afa949 is going to be created. [ 1081.208344] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.208567] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.208696] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.208965] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.210071] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.210071] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-46e16a0e-38cf-4f16-954a-d300d8afa949" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.268858] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.269043] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.269092] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.269311] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.269419] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.465805] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-378c3841-8f36-4e7a-8646-033f27e348d9 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.466270] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-378c3841-8f36-4e7a-8646-033f27e348d9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.466270] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-378c3841-8f36-4e7a-8646-033f27e348d9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.466270] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-378c3841-8f36-4e7a-8646-033f27e348d9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.466436] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.466582] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.466622] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.466793] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.466895] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.467047] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-378c3841-8f36-4e7a-8646-033f27e348d9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.467172] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-378c3841-8f36-4e7a-8646-033f27e348d9 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.467249] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-378c3841-8f36-4e7a-8646-033f27e348d9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.467300] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-378c3841-8f36-4e7a-8646-033f27e348d9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.467436] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-378c3841-8f36-4e7a-8646-033f27e348d9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.467575] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.467660] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.467720] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.467856] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.467931] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.468019] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-378c3841-8f36-4e7a-8646-033f27e348d9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.468110] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('378c3841-8f36-4e7a-8646-033f27e348d9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.771675] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.867494] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4607d7c6-d635-4a5a-9767-6150fed7c420 in Status: SUCCESS [ 1081.867494] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4607d7c6-d635-4a5a-9767-6150fed7c420" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.970195] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 378c3841-8f36-4e7a-8646-033f27e348d9: rpc.has_security_group_logging(os_id): False [ 1081.988950] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.989562] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.989562] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.989562] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.989562] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.989929] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.989929] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.989929] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.990078] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.990158] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.990338] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.990436] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.990500] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.990639] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.990711] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.990896] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.990987] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.991051] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.991196] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.991264] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.991348] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 378c3841-8f36-4e7a-8646-033f27e348d9 is going to be created. [ 1081.994216] env[68328]: INFO networking_nsxv3.common.synchronization [req-479233b2-1ff8-423f-bcaa-25a2195739e5 req-3388bc35-08fb-44a9-aa1f-de056e349b69 service nova] Enqueued Resource ID: e27762cf-c0f5-443d-8332-584b8241d0be with Priority: HIGHEST for action security_group_rules [ 1081.994436] env[68328]: INFO networking_nsxv3.common.synchronization [req-479233b2-1ff8-423f-bcaa-25a2195739e5 req-3388bc35-08fb-44a9-aa1f-de056e349b69 service nova] Enqueued Resource ID: e27762cf-c0f5-443d-8332-584b8241d0be with Priority: HIGHEST for action security_group_members [ 1081.994537] env[68328]: INFO networking_nsxv3.common.synchronization [req-479233b2-1ff8-423f-bcaa-25a2195739e5 req-3388bc35-08fb-44a9-aa1f-de056e349b69 service nova] Enqueued Resource ID: 46e16a0e-38cf-4f16-954a-d300d8afa949 with Priority: HIGHEST for action port [ 1081.994753] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e27762cf-c0f5-443d-8332-584b8241d0be with Priority: HIGHEST for action security_group_rules [ 1081.994894] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e27762cf-c0f5-443d-8332-584b8241d0be with Priority: HIGHEST for action security_group_members [ 1081.994984] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46e16a0e-38cf-4f16-954a-d300d8afa949 with Priority: HIGHEST for action port [ 1081.995525] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e27762cf-c0f5-443d-8332-584b8241d0be taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.995638] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e27762cf-c0f5-443d-8332-584b8241d0be" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.995702] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e27762cf-c0f5-443d-8332-584b8241d0be" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.995851] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e27762cf-c0f5-443d-8332-584b8241d0be" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.995929] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e27762cf-c0f5-443d-8332-584b8241d0be',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.997195] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-e27762cf-c0f5-443d-8332-584b8241d0be taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.999409] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e27762cf-c0f5-443d-8332-584b8241d0be" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.999409] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e27762cf-c0f5-443d-8332-584b8241d0be" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.999409] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e27762cf-c0f5-443d-8332-584b8241d0be" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.999409] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.999409] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.999409] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.999409] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.999409] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.999409] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e27762cf-c0f5-443d-8332-584b8241d0be',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.999409] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-46e16a0e-38cf-4f16-954a-d300d8afa949 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.999409] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-46e16a0e-38cf-4f16-954a-d300d8afa949" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.999409] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-46e16a0e-38cf-4f16-954a-d300d8afa949" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.999409] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-46e16a0e-38cf-4f16-954a-d300d8afa949" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.999409] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46e16a0e-38cf-4f16-954a-d300d8afa949',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.042503] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.042682] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.042766] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.043013] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.043209] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.052684] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 378c3841-8f36-4e7a-8646-033f27e348d9 in Status: IN_PROGRESS for 2s [ 1082.274781] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.501484] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-e27762cf-c0f5-443d-8332-584b8241d0be taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.501831] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e27762cf-c0f5-443d-8332-584b8241d0be" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.502737] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e27762cf-c0f5-443d-8332-584b8241d0be',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.504064] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 46e16a0e-38cf-4f16-954a-d300d8afa949 with status ACTIVE [ 1082.504335] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.504506] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.504622] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.504881] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.505052] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.508420] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.508420] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.508420] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.508420] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.508420] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.508420] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.508420] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.508420] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.508420] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.508420] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.508420] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 46e16a0e-38cf-4f16-954a-d300d8afa949 is going to be updated. [ 1082.527109] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.527335] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.527406] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.527628] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.527870] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.528098] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-46e16a0e-38cf-4f16-954a-d300d8afa949" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.780202] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1082.780258] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1082.947183] env[68328]: INFO networking_nsxv3.common.synchronization [None req-e7400a95-4a7f-426f-a1dd-d58ccbafa8b2 tempest-ServerActionsTestOtherA-501294167 tempest-ServerActionsTestOtherA-501294167-project-member] Enqueued Resource ID: 1b5440d1-45ae-41d0-a9b6-24cc237ec6a2 with Priority: HIGHEST for action security_group_rules [ 1082.947929] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b5440d1-45ae-41d0-a9b6-24cc237ec6a2 with Priority: HIGHEST for action security_group_rules [ 1082.948220] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b5440d1-45ae-41d0-a9b6-24cc237ec6a2 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.948339] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b5440d1-45ae-41d0-a9b6-24cc237ec6a2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.948404] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b5440d1-45ae-41d0-a9b6-24cc237ec6a2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.948652] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b5440d1-45ae-41d0-a9b6-24cc237ec6a2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.948757] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b5440d1-45ae-41d0-a9b6-24cc237ec6a2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.009142] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e27762cf-c0f5-443d-8332-584b8241d0be',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.112907] env[68328]: INFO networking_nsxv3.common.synchronization [None req-2b06ff7e-aff4-4507-a6ca-063e3448e775 tempest-ServerActionsTestOtherA-501294167 tempest-ServerActionsTestOtherA-501294167-project-member] Enqueued Resource ID: 1b5440d1-45ae-41d0-a9b6-24cc237ec6a2 with Priority: HIGHEST for action security_group_rules [ 1083.113542] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b5440d1-45ae-41d0-a9b6-24cc237ec6a2 with Priority: HIGHEST for action security_group_rules [ 1083.113910] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b5440d1-45ae-41d0-a9b6-24cc237ec6a2 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.114097] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b5440d1-45ae-41d0-a9b6-24cc237ec6a2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.368828] env[68328]: INFO networking_nsxv3.common.synchronization [req-b121f1ed-b339-42cb-bb20-e5b9ae305968 req-02579e84-a6b8-48ab-b5e2-e2c4e3e8a43c tempest-ServerRescueTestJSON-1284245856 tempest-ServerRescueTestJSON-1284245856-project-member] Enqueued Resource ID: fdf99f09-b7da-4a5c-af72-042c6f58dc8e with Priority: HIGHEST for action security_group_members [ 1083.369404] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdf99f09-b7da-4a5c-af72-042c6f58dc8e with Priority: HIGHEST for action security_group_members [ 1083.369707] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.369827] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.369890] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.370948] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.371121] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.371411] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.371524] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.371694] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.371782] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.372045] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fdf99f09-b7da-4a5c-af72-042c6f58dc8e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.471185] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.471378] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.471437] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.471633] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.471814] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.471891] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b5440d1-45ae-41d0-a9b6-24cc237ec6a2 already deleted. [ 1083.471948] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b5440d1-45ae-41d0-a9b6-24cc237ec6a2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.476091] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b5440d1-45ae-41d0-a9b6-24cc237ec6a2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.476303] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b5440d1-45ae-41d0-a9b6-24cc237ec6a2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.476869] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b5440d1-45ae-41d0-a9b6-24cc237ec6a2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.513112] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.513112] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.513112] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.513112] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.513112] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.513112] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e27762cf-c0f5-443d-8332-584b8241d0be is going to be created. [ 1083.530373] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.530373] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.530373] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.530373] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.549021] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1083.549021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.549021] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1083.550412] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.550822] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.551021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.551322] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.551696] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.561240] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e27762cf-c0f5-443d-8332-584b8241d0be in Status: UNINITIALIZED for 2s [ 1083.590020] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.590020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.590020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.590020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.601392] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.602449] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1083.602669] env[68328]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=68328) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1083.604219] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1083.641020] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.641020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.641020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.641020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.642031] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.642345] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1083.721961] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.722132] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.722171] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.722449] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.722705] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.722990] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1083.799103] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.799276] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.799385] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.799563] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.799850] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.800178] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:50. [ 1083.800313] env[68328]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'ccbebeb4-60d7-4344-b96e-b9dfdeae14b1', 'd7acb0b1-c9e7-4016-8d0b-c700463d32e1', 'e50e8525-9eb2-4aff-9a46-c4c1621d14db', 'fef607f8-3758-4e8a-87f1-a5984690df6e', 'b5812c2b-73e7-421d-b4bb-29c4ef848f3f', '55f209f1-d8fe-4d5e-a886-797753b1b3c1', '870ec36b-ba1d-4422-a26d-1328f51f79e4', '0c5088e7-0ed1-4112-b902-8fd593a8b34e', '378c3841-8f36-4e7a-8646-033f27e348d9', '249b36cf-74ee-44d9-b2c9-d728a30d9a09', 'da43fcb3-a053-41ce-ac92-ba868643fc4b', 'f0bcdd73-03e5-43ee-a623-9ac2490cee8f', '8f95f28e-3c21-415e-9067-7aef8eff10d3', '14cff10c-171f-4bbf-8531-6de5c6c7cc48', '3e399462-679e-43d6-8b03-2876938fc726', '76f74d16-9031-4472-a81b-f9ada0520a34', 'e6de510a-9045-41b5-b9c0-0c2740830426', '398e93bc-b7ea-4684-aa02-2e6ab22c1fe5', '35b651ef-47c8-4ff2-b472-9849f375b8c9', '9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a', '4bbd48a8-069c-43ef-b15c-47d19b8c7798', 'd160efa7-0312-433f-b94f-cf7e99e24473', '5841566c-1d05-4389-b8a7-950b5f9c6708', 'b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2', 'b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed', '57b7bbe5-8e54-4d67-b8c6-8cfc418f7042', '64f74f98-269e-44e8-8235-fe4f7a472b01', 'f0811b65-cde4-4246-a2e0-5bbd90921f5b', '261361c9-81c8-47fa-9a8a-4e37a8a439d7', 'c897dadb-95bc-4de7-a117-d38870fbace8', '3b0dcde5-1c71-45fa-b1b1-331b2ba39902', 'b3fc1540-17fb-42c4-99d2-880ae35db079', '8024e0cc-9eaa-4282-b00c-9e9b1de030e2', '3826a056-9a94-48ea-97d8-49b840d3fb63', '70738fbe-b41d-467c-86c7-92a8c5a2a723', '078ed1cc-5f72-48f4-8e16-b1d53057c32e', '72ca69cd-fcd9-4815-b331-9858d9cfad42', '6e39d3b8-c430-4219-9295-992b699ce546', '7c35aa45-69e7-4952-b5d8-8a7d6b3460e1', '551b86cb-6c17-4238-9ac7-89fd77e1e91b', '8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b', 'b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38', 'ce9938d1-497b-4835-b26f-069491d36e2e', '55dff300-131a-42f9-920d-f2b5a3b91449', 'fdf99f09-b7da-4a5c-af72-042c6f58dc8e', '4607d7c6-d635-4a5a-9767-6150fed7c420', '54390b69-5280-4540-a63f-fa4daae4a11f', '7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63', '136bcfc4-bc92-46ea-9e01-01b9a11704ee', '57513254-a6e5-4b1e-87b8-b529d35f4b6b'} {{(pid=68328) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1083.800459] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1083.818107] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.818267] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.818438] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.818571] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.818698] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.818799] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1083.819084] env[68328]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=68328) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1083.819084] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1083.876889] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fdf99f09-b7da-4a5c-af72-042c6f58dc8e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.905350] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.905596] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.905596] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.905774] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.906859] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.907087] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1083.907179] env[68328]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=68328) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1083.907261] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1083.907306] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1083.907354] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/50 resources of Type:Security Group Rules [ 1083.907429] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 with Priority: HIGH for action security_group_rules [ 1083.907531] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d7acb0b1-c9e7-4016-8d0b-c700463d32e1 with Priority: HIGH for action security_group_rules [ 1083.908081] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e50e8525-9eb2-4aff-9a46-c4c1621d14db with Priority: HIGH for action security_group_rules [ 1083.908081] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fef607f8-3758-4e8a-87f1-a5984690df6e with Priority: HIGH for action security_group_rules [ 1083.908081] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f with Priority: HIGH for action security_group_rules [ 1083.908081] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 with Priority: HIGH for action security_group_rules [ 1083.908081] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 with Priority: HIGH for action security_group_rules [ 1083.908081] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0c5088e7-0ed1-4112-b902-8fd593a8b34e with Priority: HIGH for action security_group_rules [ 1083.908081] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 378c3841-8f36-4e7a-8646-033f27e348d9 with Priority: HIGH for action security_group_rules [ 1083.908081] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 with Priority: HIGH for action security_group_rules [ 1083.908081] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: da43fcb3-a053-41ce-ac92-ba868643fc4b with Priority: HIGH for action security_group_rules [ 1083.908081] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f with Priority: HIGH for action security_group_rules [ 1083.910115] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8f95f28e-3c21-415e-9067-7aef8eff10d3 with Priority: HIGH for action security_group_rules [ 1083.910115] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 14cff10c-171f-4bbf-8531-6de5c6c7cc48 with Priority: HIGH for action security_group_rules [ 1083.910115] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3e399462-679e-43d6-8b03-2876938fc726 with Priority: HIGH for action security_group_rules [ 1083.910115] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 76f74d16-9031-4472-a81b-f9ada0520a34 with Priority: HIGH for action security_group_rules [ 1083.910115] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e6de510a-9045-41b5-b9c0-0c2740830426 with Priority: HIGH for action security_group_rules [ 1083.910115] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 with Priority: HIGH for action security_group_rules [ 1083.910115] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 with Priority: HIGH for action security_group_rules [ 1083.910115] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a with Priority: HIGH for action security_group_rules [ 1083.910115] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.001686] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.001686] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.001686] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.001686] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.001686] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.001686] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b5440d1-45ae-41d0-a9b6-24cc237ec6a2 already deleted. [ 1084.001686] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b5440d1-45ae-41d0-a9b6-24cc237ec6a2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.064608] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 378c3841-8f36-4e7a-8646-033f27e348d9 in Status: SUCCESS [ 1084.064877] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-378c3841-8f36-4e7a-8646-033f27e348d9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.378885] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fdf99f09-b7da-4a5c-af72-042c6f58dc8e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.884085] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.884373] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.884373] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.884604] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.884707] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.884834] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdf99f09-b7da-4a5c-af72-042c6f58dc8e is going to be updated. [ 1084.911192] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.911310] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.911374] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.911582] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.911736] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.920081] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdf99f09-b7da-4a5c-af72-042c6f58dc8e in Status: IN_PROGRESS for 2s [ 1085.270438] env[68328]: INFO networking_nsxv3.common.synchronization [req-ed366169-8021-4f13-b87f-1ad442ee7547 req-5329defd-b16d-4cb9-953f-94c88c4756c7 tempest-DeleteServersTestJSON-1696259291 tempest-DeleteServersTestJSON-1696259291-project-member] Enqueued Resource ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 with Priority: HIGHEST for action security_group_members [ 1085.271602] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 with Priority: HIGHEST for action security_group_members [ 1085.271602] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 with Priority: HIGH for action security_group_rules [ 1085.271602] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e50e8525-9eb2-4aff-9a46-c4c1621d14db with Priority: HIGH for action security_group_rules [ 1085.271602] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 with Priority: HIGH for action security_group_rules [ 1085.271602] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e399462-679e-43d6-8b03-2876938fc726 with Priority: HIGH for action security_group_rules [ 1085.271602] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a with Priority: HIGH for action security_group_rules [ 1085.271859] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 with Priority: HIGH for action security_group_rules [ 1085.271859] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 with Priority: HIGH for action security_group_rules [ 1085.271859] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6de510a-9045-41b5-b9c0-0c2740830426 with Priority: HIGH for action security_group_rules [ 1085.271971] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14cff10c-171f-4bbf-8531-6de5c6c7cc48 with Priority: HIGH for action security_group_rules [ 1085.272039] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76f74d16-9031-4472-a81b-f9ada0520a34 with Priority: HIGH for action security_group_rules [ 1085.272126] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f95f28e-3c21-415e-9067-7aef8eff10d3 with Priority: HIGH for action security_group_rules [ 1085.272208] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f with Priority: HIGH for action security_group_rules [ 1085.272292] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da43fcb3-a053-41ce-ac92-ba868643fc4b with Priority: HIGH for action security_group_rules [ 1085.272374] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 with Priority: HIGH for action security_group_rules [ 1085.272463] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 378c3841-8f36-4e7a-8646-033f27e348d9 with Priority: HIGH for action security_group_rules [ 1085.272585] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 with Priority: HIGH for action security_group_rules [ 1085.272702] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c5088e7-0ed1-4112-b902-8fd593a8b34e with Priority: HIGH for action security_group_rules [ 1085.272791] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f with Priority: HIGH for action security_group_rules [ 1085.272878] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7acb0b1-c9e7-4016-8d0b-c700463d32e1 with Priority: HIGH for action security_group_rules [ 1085.272963] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fef607f8-3758-4e8a-87f1-a5984690df6e with Priority: HIGH for action security_group_rules [ 1085.273305] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.273488] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.273488] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.273687] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.273850] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.273945] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.274012] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.274164] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.274254] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.274333] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c35aa45-69e7-4952-b5d8-8a7d6b3460e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.275345] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.275431] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.275986] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.275986] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.275986] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ccbebeb4-60d7-4344-b96e-b9dfdeae14b1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.280175] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e50e8525-9eb2-4aff-9a46-c4c1621d14db taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.280175] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e50e8525-9eb2-4aff-9a46-c4c1621d14db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.280175] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e50e8525-9eb2-4aff-9a46-c4c1621d14db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.280175] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e50e8525-9eb2-4aff-9a46-c4c1621d14db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.280175] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e50e8525-9eb2-4aff-9a46-c4c1621d14db',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.280175] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-870ec36b-ba1d-4422-a26d-1328f51f79e4 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.280175] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.280175] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.280175] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.280175] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('870ec36b-ba1d-4422-a26d-1328f51f79e4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.281025] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e399462-679e-43d6-8b03-2876938fc726 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.281025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.281025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.281025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.281222] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e399462-679e-43d6-8b03-2876938fc726',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.281779] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.281878] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.281941] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.282099] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.282180] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.282916] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-35b651ef-47c8-4ff2-b472-9849f375b8c9 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.283036] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.283108] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.283274] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.283930] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('35b651ef-47c8-4ff2-b472-9849f375b8c9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.284219] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.284330] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.284412] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.284536] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.284611] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('398e93bc-b7ea-4684-aa02-2e6ab22c1fe5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.285412] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6de510a-9045-41b5-b9c0-0c2740830426 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.285560] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6de510a-9045-41b5-b9c0-0c2740830426" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.285927] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6de510a-9045-41b5-b9c0-0c2740830426" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.285927] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6de510a-9045-41b5-b9c0-0c2740830426" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.286019] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6de510a-9045-41b5-b9c0-0c2740830426',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.286827] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14cff10c-171f-4bbf-8531-6de5c6c7cc48 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.286993] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14cff10c-171f-4bbf-8531-6de5c6c7cc48" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.287113] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14cff10c-171f-4bbf-8531-6de5c6c7cc48" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.287354] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14cff10c-171f-4bbf-8531-6de5c6c7cc48" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.288847] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14cff10c-171f-4bbf-8531-6de5c6c7cc48',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.288847] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76f74d16-9031-4472-a81b-f9ada0520a34 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.288847] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76f74d16-9031-4472-a81b-f9ada0520a34" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.288847] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76f74d16-9031-4472-a81b-f9ada0520a34" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.288847] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76f74d16-9031-4472-a81b-f9ada0520a34" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.288847] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76f74d16-9031-4472-a81b-f9ada0520a34',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.289677] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f95f28e-3c21-415e-9067-7aef8eff10d3 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.289778] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f95f28e-3c21-415e-9067-7aef8eff10d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.289930] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f95f28e-3c21-415e-9067-7aef8eff10d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.290060] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f95f28e-3c21-415e-9067-7aef8eff10d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.290140] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f95f28e-3c21-415e-9067-7aef8eff10d3',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.290849] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f0bcdd73-03e5-43ee-a623-9ac2490cee8f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.291023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.291023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.291158] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.291229] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f0bcdd73-03e5-43ee-a623-9ac2490cee8f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.291902] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da43fcb3-a053-41ce-ac92-ba868643fc4b taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.292047] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.292092] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.292225] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.292290] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da43fcb3-a053-41ce-ac92-ba868643fc4b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.292971] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-249b36cf-74ee-44d9-b2c9-d728a30d9a09 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.293117] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.293173] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.293289] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.293358] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('249b36cf-74ee-44d9-b2c9-d728a30d9a09',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.294518] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-378c3841-8f36-4e7a-8646-033f27e348d9 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.294518] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-378c3841-8f36-4e7a-8646-033f27e348d9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.294518] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-378c3841-8f36-4e7a-8646-033f27e348d9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.294518] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-378c3841-8f36-4e7a-8646-033f27e348d9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.294518] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('378c3841-8f36-4e7a-8646-033f27e348d9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.295153] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55f209f1-d8fe-4d5e-a886-797753b1b3c1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.295260] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.295322] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.295482] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.295606] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55f209f1-d8fe-4d5e-a886-797753b1b3c1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.296213] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c5088e7-0ed1-4112-b902-8fd593a8b34e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.296318] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c5088e7-0ed1-4112-b902-8fd593a8b34e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.296366] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c5088e7-0ed1-4112-b902-8fd593a8b34e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.296512] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c5088e7-0ed1-4112-b902-8fd593a8b34e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.296578] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c5088e7-0ed1-4112-b902-8fd593a8b34e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.297338] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b5812c2b-73e7-421d-b4bb-29c4ef848f3f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.297454] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.297504] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.297621] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.297692] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b5812c2b-73e7-421d-b4bb-29c4ef848f3f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.299169] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d7acb0b1-c9e7-4016-8d0b-c700463d32e1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.299305] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.299391] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.299580] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.299676] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d7acb0b1-c9e7-4016-8d0b-c700463d32e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.300856] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fef607f8-3758-4e8a-87f1-a5984690df6e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.301115] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.301115] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.301260] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.301354] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fef607f8-3758-4e8a-87f1-a5984690df6e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.570130] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e27762cf-c0f5-443d-8332-584b8241d0be in Status: SUCCESS [ 1085.570343] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e27762cf-c0f5-443d-8332-584b8241d0be" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.570856] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e27762cf-c0f5-443d-8332-584b8241d0be" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.571093] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e27762cf-c0f5-443d-8332-584b8241d0be" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.571284] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.571399] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.571463] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.571618] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.571697] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.571798] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e27762cf-c0f5-443d-8332-584b8241d0be" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.571887] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e27762cf-c0f5-443d-8332-584b8241d0be',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.805558] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.805735] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.805793] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.806012] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.806184] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.806283] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.806345] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.806499] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.806585] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.806707] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.806759] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f0bcdd73-03e5-43ee-a623-9ac2490cee8f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.809729] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.809967] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.809967] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.810192] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.811016] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.811178] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.811178] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.811334] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.811457] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.811574] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.811651] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.811817] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.811935] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.812037] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.812126] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.816553] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-e50e8525-9eb2-4aff-9a46-c4c1621d14db taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.816691] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e50e8525-9eb2-4aff-9a46-c4c1621d14db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.816749] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e50e8525-9eb2-4aff-9a46-c4c1621d14db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.816956] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e50e8525-9eb2-4aff-9a46-c4c1621d14db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.817107] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.817211] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.817261] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.817455] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.817570] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.817659] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e50e8525-9eb2-4aff-9a46-c4c1621d14db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.817782] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e50e8525-9eb2-4aff-9a46-c4c1621d14db',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.818731] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-378c3841-8f36-4e7a-8646-033f27e348d9 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.818859] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-378c3841-8f36-4e7a-8646-033f27e348d9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.818908] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-378c3841-8f36-4e7a-8646-033f27e348d9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.819054] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-378c3841-8f36-4e7a-8646-033f27e348d9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.819197] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.819292] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.819348] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.819487] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.819567] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.819696] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-378c3841-8f36-4e7a-8646-033f27e348d9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.819748] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('378c3841-8f36-4e7a-8646-033f27e348d9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.820852] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-35b651ef-47c8-4ff2-b472-9849f375b8c9 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.820971] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.821044] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.821179] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.821318] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.821409] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.821474] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.821610] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.821685] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.821765] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.821845] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('35b651ef-47c8-4ff2-b472-9849f375b8c9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.830023] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.833432] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.833586] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.833640] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.833919] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.834099] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.834230] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.834303] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.834467] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.834553] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.834649] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.834824] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.834923] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.834984] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.835184] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.835335] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.835465] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.835558] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.835730] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.835826] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.835948] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.836056] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f0bcdd73-03e5-43ee-a623-9ac2490cee8f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.843857] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-fef607f8-3758-4e8a-87f1-a5984690df6e taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.843985] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.844074] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.844357] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.844486] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.844584] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.844647] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.844791] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.844886] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.844960] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.845060] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fef607f8-3758-4e8a-87f1-a5984690df6e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.851495] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f0bcdd73-03e5-43ee-a623-9ac2490cee8f: rpc.has_security_group_logging(os_id): False [ 1085.855948] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a: rpc.has_security_group_logging(os_id): False [ 1085.946282] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.946602] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.947409] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.947511] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.948530] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.948669] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.949535] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.949644] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.951043] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.951043] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.951403] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.951657] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.952599] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.952689] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.954143] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.954143] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.954590] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.954679] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.955525] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.955625] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.956228] env[68328]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1085.956892] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.956892] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.957456] env[68328]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1085.957976] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.958146] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.958861] env[68328]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1085.959298] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.959436] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.960118] env[68328]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1085.960776] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.960776] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.961837] env[68328]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1085.961900] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.961975] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.962765] env[68328]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1085.963342] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.963745] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.963922] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.963993] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.964223] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.964408] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.964408] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 is going to be updated. [ 1085.965485] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.965759] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.967175] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.967275] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.985377] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.985377] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 is going to be deleted. [ 1085.985572] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.985786] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.994401] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.994401] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.994683] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.994683] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.995256] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.003021] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 in Status: IN_PROGRESS for 2s [ 1086.005174] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.005321] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55f209f1-d8fe-4d5e-a886-797753b1b3c1 is going to be deleted. [ 1086.006157] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.007454] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.028017] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.028017] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6de510a-9045-41b5-b9c0-0c2740830426 is going to be deleted. [ 1086.028017] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.028017] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.039823] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.039959] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.050336] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.050792] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76f74d16-9031-4472-a81b-f9ada0520a34 is going to be deleted. [ 1086.051626] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.051915] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.054582] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.054582] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.071675] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.071965] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c5088e7-0ed1-4112-b902-8fd593a8b34e is going to be deleted. [ 1086.072832] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.073092] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.074491] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.074602] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.074872] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e27762cf-c0f5-443d-8332-584b8241d0be',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.151394] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.151722] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.151828] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.151915] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.152222] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.152281] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.152386] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a is going to be updated. [ 1086.153685] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.153879] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.155704] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.155802] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.223611] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.223611] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.231032] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.231168] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e399462-679e-43d6-8b03-2876938fc726 is going to be deleted. [ 1086.232938] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.233162] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.284167] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.284294] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b5812c2b-73e7-421d-b4bb-29c4ef848f3f is going to be deleted. [ 1086.285186] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.285412] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.327938] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e50e8525-9eb2-4aff-9a46-c4c1621d14db',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.328368] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('35b651ef-47c8-4ff2-b472-9849f375b8c9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.341779] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-378c3841-8f36-4e7a-8646-033f27e348d9 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.341938] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-378c3841-8f36-4e7a-8646-033f27e348d9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.342069] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-378c3841-8f36-4e7a-8646-033f27e348d9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.342308] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-378c3841-8f36-4e7a-8646-033f27e348d9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.342502] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.342653] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.342734] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.342906] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.343010] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.343106] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-378c3841-8f36-4e7a-8646-033f27e348d9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.343264] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-378c3841-8f36-4e7a-8646-033f27e348d9 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.343353] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-378c3841-8f36-4e7a-8646-033f27e348d9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.343413] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-378c3841-8f36-4e7a-8646-033f27e348d9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.343570] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-378c3841-8f36-4e7a-8646-033f27e348d9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.343704] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.343938] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.343938] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.344051] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.344097] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.344170] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-378c3841-8f36-4e7a-8646-033f27e348d9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.344426] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('378c3841-8f36-4e7a-8646-033f27e348d9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.351470] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.351626] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.351813] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-fef607f8-3758-4e8a-87f1-a5984690df6e taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.351910] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.351964] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.353081] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.353081] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.353081] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.353081] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.353081] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.353081] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.353081] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.353081] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-fef607f8-3758-4e8a-87f1-a5984690df6e taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.353081] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.353404] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.353404] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.353603] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.353823] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.353953] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.354117] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.354204] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.354278] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.354380] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fef607f8-3758-4e8a-87f1-a5984690df6e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.358924] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.359110] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.374382] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.374382] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14cff10c-171f-4bbf-8531-6de5c6c7cc48 is going to be deleted. [ 1086.375329] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.375595] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.407351] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.407485] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.426117] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.426117] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f95f28e-3c21-415e-9067-7aef8eff10d3 is going to be deleted. [ 1086.427818] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.428418] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.475570] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.475741] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d7acb0b1-c9e7-4016-8d0b-c700463d32e1 is going to be deleted. [ 1086.476729] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.476971] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.497727] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.497727] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.564077] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.564077] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 870ec36b-ba1d-4422-a26d-1328f51f79e4 is going to be deleted. [ 1086.564077] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.564077] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.577136] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e27762cf-c0f5-443d-8332-584b8241d0be: rpc.has_security_group_logging(os_id): False [ 1086.590756] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.590756] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.633189] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.633189] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.646224] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.646224] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ccbebeb4-60d7-4344-b96e-b9dfdeae14b1 is going to be deleted. [ 1086.646930] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.651046] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.657124] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.657239] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.712351] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.712575] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.733286] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.733430] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 249b36cf-74ee-44d9-b2c9-d728a30d9a09 is going to be deleted. [ 1086.735028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.735028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.779014] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.779543] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.779705] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.779705] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.780994] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.780994] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.780994] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.780994] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.780994] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.780994] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.780994] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.780994] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.780994] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.780994] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.781408] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.781408] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.781408] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f is going to be updated. [ 1086.782538] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.782671] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.782947] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.782947] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.783122] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.783151] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.783228] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.783341] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55f209f1-d8fe-4d5e-a886-797753b1b3c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.783492] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.783656] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.783735] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.783845] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6de510a-9045-41b5-b9c0-0c2740830426" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.783953] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.784108] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.826886] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.827207] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.828443] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.828568] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da43fcb3-a053-41ce-ac92-ba868643fc4b is going to be deleted. [ 1086.829888] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.829888] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.829888] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.829888] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c5088e7-0ed1-4112-b902-8fd593a8b34e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.830091] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 35b651ef-47c8-4ff2-b472-9849f375b8c9: rpc.has_security_group_logging(os_id): False [ 1086.830865] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.831054] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.831194] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.832108] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e50e8525-9eb2-4aff-9a46-c4c1621d14db: rpc.has_security_group_logging(os_id): False [ 1086.833174] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.833339] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.833423] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.833541] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e399462-679e-43d6-8b03-2876938fc726" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.834066] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.834271] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.834355] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.834468] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b5812c2b-73e7-421d-b4bb-29c4ef848f3f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.835087] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.835302] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.835395] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.835512] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14cff10c-171f-4bbf-8531-6de5c6c7cc48" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.835644] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.835912] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.835991] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.836106] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f95f28e-3c21-415e-9067-7aef8eff10d3" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.836229] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.836370] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.836443] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.836696] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.836783] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.836838] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.836972] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.837055] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.837142] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e27762cf-c0f5-443d-8332-584b8241d0be is going to be created. [ 1086.837995] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.838165] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.838245] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.838366] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.838476] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.838604] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.838679] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.838786] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-870ec36b-ba1d-4422-a26d-1328f51f79e4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.838920] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.839084] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.839145] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.839247] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76f74d16-9031-4472-a81b-f9ada0520a34" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.839352] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.839489] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.839692] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.839692] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ccbebeb4-60d7-4344-b96e-b9dfdeae14b1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.846261] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 378c3841-8f36-4e7a-8646-033f27e348d9: rpc.has_security_group_logging(os_id): False [ 1086.856749] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fef607f8-3758-4e8a-87f1-a5984690df6e: rpc.has_security_group_logging(os_id): False [ 1086.866257] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.866388] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.866432] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.866774] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.866774] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.866906] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-249b36cf-74ee-44d9-b2c9-d728a30d9a09" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.882023] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a in Status: IN_PROGRESS for 2s [ 1086.886365] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.886365] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.886365] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.886631] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.887654] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.887791] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.888995] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.889129] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.889713] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.889838] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.963231] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdf99f09-b7da-4a5c-af72-042c6f58dc8e in Status: SUCCESS [ 1086.963606] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.969404] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.969509] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.978801] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.979146] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.979251] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.979481] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.979898] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.979898] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.979898] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 is going to be updated. [ 1086.985022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.985022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.993527] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.993692] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.016788] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.016925] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.055513] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.055513] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.055513] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.055513] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.055513] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.055513] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.055787] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.055787] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.055861] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.055959] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.056056] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.056359] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.056601] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.056601] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.056838] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.056914] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.057035] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fef607f8-3758-4e8a-87f1-a5984690df6e is going to be updated. [ 1087.058207] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.058401] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.095711] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.099018] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.099018] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.099018] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.099018] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.099018] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.099018] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e50e8525-9eb2-4aff-9a46-c4c1621d14db is going to be updated. [ 1087.099018] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.099018] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.114924] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.115065] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.135031] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.135348] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.135484] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.135554] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.135812] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.135902] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.136169] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.136333] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.136437] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.136612] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.136688] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.136878] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.136955] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.137021] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.137159] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.137228] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.137318] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 378c3841-8f36-4e7a-8646-033f27e348d9 is going to be updated. [ 1087.138370] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.138539] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.138715] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.139646] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.139797] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.139921] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.140808] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.141031] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.141136] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.141258] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da43fcb3-a053-41ce-ac92-ba868643fc4b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.141402] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.141546] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.143041] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.163747] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 in Status: IN_PROGRESS for 2s [ 1087.204193] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e27762cf-c0f5-443d-8332-584b8241d0be in Status: IN_PROGRESS for 2s [ 1087.208659] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f in Status: IN_PROGRESS for 2s [ 1087.220191] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.220328] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.220368] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.220611] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.220960] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.265675] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fef607f8-3758-4e8a-87f1-a5984690df6e in Status: IN_PROGRESS for 2s [ 1087.275099] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.275099] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.275099] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.275099] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.276063] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.308894] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e50e8525-9eb2-4aff-9a46-c4c1621d14db in Status: IN_PROGRESS for 2s [ 1087.346119] env[68328]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1087.346119] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.346119] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.346119] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.346119] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.346119] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.371717] env[68328]: INFO networking_nsxv3.common.synchronization [req-52098435-6273-467d-940c-59d8433fd8c8 req-78d8477b-97f3-42aa-81f0-4e688e86fae9 tempest-ServerMetadataTestJSON-1827292363 tempest-ServerMetadataTestJSON-1827292363-project-member] Enqueued Resource ID: 4607d7c6-d635-4a5a-9767-6150fed7c420 with Priority: HIGHEST for action security_group_members [ 1087.372840] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4607d7c6-d635-4a5a-9767-6150fed7c420 with Priority: HIGHEST for action security_group_members [ 1087.373393] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-4607d7c6-d635-4a5a-9767-6150fed7c420 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.373733] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4607d7c6-d635-4a5a-9767-6150fed7c420" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.373976] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4607d7c6-d635-4a5a-9767-6150fed7c420" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.377020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4607d7c6-d635-4a5a-9767-6150fed7c420" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.377020] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.377020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.377020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.377020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.377020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.377020] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4607d7c6-d635-4a5a-9767-6150fed7c420',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.377020] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 378c3841-8f36-4e7a-8646-033f27e348d9 in Status: IN_PROGRESS for 2s [ 1087.881974] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.882183] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.882258] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.882484] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.901847] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.902177] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.902396] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.902510] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.902838] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.902948] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.903094] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4607d7c6-d635-4a5a-9767-6150fed7c420 is going to be updated. [ 1087.926157] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.926281] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.926351] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.926557] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.926694] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.934513] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4607d7c6-d635-4a5a-9767-6150fed7c420 in Status: IN_PROGRESS for 2s [ 1088.012296] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 in Status: SUCCESS [ 1088.012957] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 deletion is rescheduled due to dependency. [ 1088.012957] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.897642] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a in Status: SUCCESS [ 1088.897642] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.148125] env[68328]: INFO networking_nsxv3.common.synchronization [req-81acc6a0-42e6-447e-a6c5-dbdc28ead38c req-6101e412-a76a-4c6c-83c3-ce90e0e6f4dd tempest-ServersTestJSON-1771388484 tempest-ServersTestJSON-1771388484-project-member] Enqueued Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_members [ 1089.148125] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_members [ 1089.148125] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-5841566c-1d05-4389-b8a7-950b5f9c6708 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.148125] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.148125] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.148125] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.148125] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.148125] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.148125] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.148125] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.149036] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.149260] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.175503] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 in Status: SUCCESS [ 1089.175503] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.215852] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e27762cf-c0f5-443d-8332-584b8241d0be in Status: SUCCESS [ 1089.215852] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e27762cf-c0f5-443d-8332-584b8241d0be" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.219123] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f in Status: SUCCESS [ 1089.219561] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.275882] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fef607f8-3758-4e8a-87f1-a5984690df6e in Status: SUCCESS [ 1089.276700] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.321185] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e50e8525-9eb2-4aff-9a46-c4c1621d14db in Status: SUCCESS [ 1089.321480] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e50e8525-9eb2-4aff-9a46-c4c1621d14db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.393575] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 378c3841-8f36-4e7a-8646-033f27e348d9 in Status: SUCCESS [ 1089.393857] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-378c3841-8f36-4e7a-8646-033f27e348d9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.465826] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-384 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.466065] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-384" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.466200] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-384" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.466480] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-384" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.466743] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.466909] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.467045] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.467351] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.467418] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.467654] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1089.467776] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1089.467890] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1089.468097] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1089.468161] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1089.468229] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1089.468363] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1089.487102] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1089.487286] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1089.487421] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1089.487607] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-384" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.488027] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-6010c10b-2a3f-409e-b68b-7ae9e629190b taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.488213] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-6010c10b-2a3f-409e-b68b-7ae9e629190b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.488340] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-6010c10b-2a3f-409e-b68b-7ae9e629190b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.488700] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-6010c10b-2a3f-409e-b68b-7ae9e629190b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.488844] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6010c10b-2a3f-409e-b68b-7ae9e629190b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.652169] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.831448] env[68328]: INFO networking_nsxv3.common.synchronization [req-51f556ad-89c1-49b4-a808-bceb1e802c6b req-0bea65a0-257a-4c46-a6c9-7bf326f95523 tempest-InstanceActionsNegativeTestJSON-795141991 tempest-InstanceActionsNegativeTestJSON-795141991-project-member] Enqueued Resource ID: 378c3841-8f36-4e7a-8646-033f27e348d9 with Priority: HIGHEST for action security_group_members [ 1089.832206] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 378c3841-8f36-4e7a-8646-033f27e348d9 with Priority: HIGHEST for action security_group_members [ 1089.832603] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-378c3841-8f36-4e7a-8646-033f27e348d9 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.832743] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-378c3841-8f36-4e7a-8646-033f27e348d9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.832815] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-378c3841-8f36-4e7a-8646-033f27e348d9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.833244] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-378c3841-8f36-4e7a-8646-033f27e348d9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.833244] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.833522] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.833522] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.833601] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.833644] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.833854] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('378c3841-8f36-4e7a-8646-033f27e348d9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.945651] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4607d7c6-d635-4a5a-9767-6150fed7c420 in Status: SUCCESS [ 1089.945908] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4607d7c6-d635-4a5a-9767-6150fed7c420 deletion is rescheduled due to dependency. [ 1089.945908] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4607d7c6-d635-4a5a-9767-6150fed7c420" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.991405] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.991607] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.991745] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.992052] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.992226] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.992397] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 6010c10b-2a3f-409e-b68b-7ae9e629190b not found, creating... [ 1089.992761] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.992930] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.993070] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.993309] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.993452] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.993762] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.993933] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.994070] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.994295] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.994421] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.994562] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 6010c10b-2a3f-409e-b68b-7ae9e629190b is going to be created. [ 1090.027284] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.027535] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.027668] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.027954] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.028210] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.028447] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-6010c10b-2a3f-409e-b68b-7ae9e629190b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.154016] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.337744] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.338032] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.338177] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.338465] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.338619] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.338893] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.339090] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.339178] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.339395] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.339502] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.339645] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 378c3841-8f36-4e7a-8646-033f27e348d9 is going to be updated. [ 1090.370023] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.370023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.370023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.370023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.370023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.377360] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 378c3841-8f36-4e7a-8646-033f27e348d9 in Status: IN_PROGRESS for 2s [ 1090.656985] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.657159] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.657227] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.659757] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.659757] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.659757] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 is going to be updated. [ 1090.687491] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.687491] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.687491] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.687491] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.687491] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.695842] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: IN_PROGRESS for 2s [ 1090.717931] env[68328]: INFO networking_nsxv3.common.synchronization [req-81acc6a0-42e6-447e-a6c5-dbdc28ead38c req-a5e95887-73d4-416f-8bfd-6b5cb56a22d6 service nova] Enqueued Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_rules [ 1090.718089] env[68328]: INFO networking_nsxv3.common.synchronization [req-81acc6a0-42e6-447e-a6c5-dbdc28ead38c req-a5e95887-73d4-416f-8bfd-6b5cb56a22d6 service nova] Enqueued Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_members [ 1090.718243] env[68328]: INFO networking_nsxv3.common.synchronization [req-81acc6a0-42e6-447e-a6c5-dbdc28ead38c req-a5e95887-73d4-416f-8bfd-6b5cb56a22d6 service nova] Enqueued Resource ID: 6010c10b-2a3f-409e-b68b-7ae9e629190b with Priority: HIGHEST for action port [ 1090.718490] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_rules [ 1090.718622] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_members [ 1090.718768] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6010c10b-2a3f-409e-b68b-7ae9e629190b with Priority: HIGHEST for action port [ 1090.719649] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5841566c-1d05-4389-b8a7-950b5f9c6708 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.719813] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.719912] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.720214] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.720300] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.722295] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-5841566c-1d05-4389-b8a7-950b5f9c6708 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.722396] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.723570] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-6010c10b-2a3f-409e-b68b-7ae9e629190b taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.723731] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6010c10b-2a3f-409e-b68b-7ae9e629190b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.723807] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6010c10b-2a3f-409e-b68b-7ae9e629190b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.724028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6010c10b-2a3f-409e-b68b-7ae9e629190b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.724113] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6010c10b-2a3f-409e-b68b-7ae9e629190b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.223696] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-5841566c-1d05-4389-b8a7-950b5f9c6708 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.223696] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.229026] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6010c10b-2a3f-409e-b68b-7ae9e629190b with status ACTIVE [ 1091.229026] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.229026] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.229026] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.229026] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.229026] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.229026] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.229026] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.229026] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.229026] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.229026] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.229026] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.229026] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.229026] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.229026] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.229026] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.229026] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6010c10b-2a3f-409e-b68b-7ae9e629190b is going to be updated. [ 1091.252993] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.252993] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.252993] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.252993] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.252993] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.252993] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6010c10b-2a3f-409e-b68b-7ae9e629190b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.394046] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 378c3841-8f36-4e7a-8646-033f27e348d9 in Status: SUCCESS [ 1092.394313] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 378c3841-8f36-4e7a-8646-033f27e348d9 deletion is rescheduled due to dependency. [ 1092.395065] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-378c3841-8f36-4e7a-8646-033f27e348d9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.709185] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: SUCCESS [ 1092.709185] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.709185] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.709185] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.709727] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.710104] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.710277] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.711606] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.711606] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.711606] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.213216] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.716056] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.220727] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.220727] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.220727] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.220727] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.220727] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.220727] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 is going to be updated. [ 1094.248908] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.249583] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.249583] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.249583] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.249583] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.258251] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: IN_PROGRESS for 2s [ 1095.720211] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1095.720479] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1096.185172] env[68328]: INFO networking_nsxv3.common.synchronization [req-be51878b-3581-42a3-a1b2-b9c74e5b4a62 req-bec7b2ca-b2ed-47ca-90af-a60a8ecb4e4f tempest-ServerDiskConfigTestJSON-155339900 tempest-ServerDiskConfigTestJSON-155339900-project-member] Enqueued Resource ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 with Priority: HIGHEST for action security_group_members [ 1096.187955] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 with Priority: HIGHEST for action security_group_members [ 1096.187955] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-261361c9-81c8-47fa-9a8a-4e37a8a439d7 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.187955] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.187955] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.187955] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.187955] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.187955] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.187955] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.187955] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.187955] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.187955] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('261361c9-81c8-47fa-9a8a-4e37a8a439d7',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.268971] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: SUCCESS [ 1096.269208] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.269364] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.269603] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.269793] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.270181] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.270181] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.270181] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.270181] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.270444] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.270444] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.693116] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.694065] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.694065] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.694065] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.728593] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.731017] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.731017] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.731017] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.731017] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.731017] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.731017] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 is going to be updated. [ 1096.758510] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.758510] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.758510] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.758510] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.758510] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.765915] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 in Status: IN_PROGRESS for 2s [ 1096.777023] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-5841566c-1d05-4389-b8a7-950b5f9c6708 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.777023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.777023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.777023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.777023] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.777023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.777023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.777023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.777023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.777023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.777023] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-5841566c-1d05-4389-b8a7-950b5f9c6708 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.777023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.777023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.777023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.777023] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.777023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.777672] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.777672] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.777672] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.777672] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.777672] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.282519] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5841566c-1d05-4389-b8a7-950b5f9c6708: rpc.has_security_group_logging(os_id): False [ 1097.301052] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.301052] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.301052] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.301052] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.319229] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.319229] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.319229] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.319229] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.319229] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.319229] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.319229] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.319229] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.319229] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.319229] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.319229] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.319229] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.319229] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.319689] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.319689] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.319689] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.319689] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 is going to be updated. [ 1097.373166] env[68328]: INFO networking_nsxv3.common.synchronization [req-b9a426d0-55cf-459c-a367-92e8c10257d5 req-0d9e06dd-4d81-4817-a964-dedaff20291d tempest-AttachVolumeTestJSON-972540760 tempest-AttachVolumeTestJSON-972540760-project-member] Enqueued Resource ID: e50e8525-9eb2-4aff-9a46-c4c1621d14db with Priority: HIGHEST for action security_group_members [ 1097.373974] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e50e8525-9eb2-4aff-9a46-c4c1621d14db with Priority: HIGHEST for action security_group_members [ 1097.375120] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-e50e8525-9eb2-4aff-9a46-c4c1621d14db taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.375252] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e50e8525-9eb2-4aff-9a46-c4c1621d14db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.375443] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e50e8525-9eb2-4aff-9a46-c4c1621d14db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.375524] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e50e8525-9eb2-4aff-9a46-c4c1621d14db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.375669] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.375934] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.375934] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.376096] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.376211] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.376339] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e50e8525-9eb2-4aff-9a46-c4c1621d14db',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.378844] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.378844] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.378971] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.379083] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.379225] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.392704] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: IN_PROGRESS for 2s [ 1097.883106] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.883106] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.883490] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.883490] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.883666] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.883985] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.884172] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.884286] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.884546] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.884696] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.884855] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e50e8525-9eb2-4aff-9a46-c4c1621d14db is going to be updated. [ 1097.909689] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.909871] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.909928] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.910223] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.910398] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.920059] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e50e8525-9eb2-4aff-9a46-c4c1621d14db in Status: IN_PROGRESS for 2s [ 1098.775496] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 in Status: SUCCESS [ 1098.775670] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 deletion is rescheduled due to dependency. [ 1098.775784] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.527727] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e50e8525-9eb2-4aff-9a46-c4c1621d14db in Status: SUCCESS [ 1100.527727] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e50e8525-9eb2-4aff-9a46-c4c1621d14db deletion is rescheduled due to dependency. [ 1100.527727] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e50e8525-9eb2-4aff-9a46-c4c1621d14db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.527727] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: SUCCESS [ 1100.527727] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.324019] env[68328]: INFO networking_nsxv3.common.synchronization [req-14063a6e-8a40-41be-9d71-9d36e15f5aa6 req-0f1499d5-8101-4379-9a49-e200eca4a51b tempest-ServerActionsTestOtherA-501294167 tempest-ServerActionsTestOtherA-501294167-project-member] Enqueued Resource ID: 1b5440d1-45ae-41d0-a9b6-24cc237ec6a2 with Priority: HIGHEST for action security_group_members [ 1101.324019] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b5440d1-45ae-41d0-a9b6-24cc237ec6a2 with Priority: HIGHEST for action security_group_members [ 1101.324019] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b5440d1-45ae-41d0-a9b6-24cc237ec6a2 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.324019] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b5440d1-45ae-41d0-a9b6-24cc237ec6a2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.324019] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b5440d1-45ae-41d0-a9b6-24cc237ec6a2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.324019] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b5440d1-45ae-41d0-a9b6-24cc237ec6a2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.324019] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.324019] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.324019] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.324019] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.324019] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.324019] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b5440d1-45ae-41d0-a9b6-24cc237ec6a2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.603490] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-113 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.603823] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-113" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.603918] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-113" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.604186] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-113" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.604517] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.604704] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.604844] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.605087] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.605260] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.605529] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1101.605676] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1101.605810] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1101.605925] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1101.606065] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1101.606181] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1101.606328] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1101.625069] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1101.625069] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1101.625208] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1101.625298] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-113" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.625602] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-24806e79-03bd-4096-996a-f7834cf9a2f7 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.625813] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-24806e79-03bd-4096-996a-f7834cf9a2f7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.625941] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-24806e79-03bd-4096-996a-f7834cf9a2f7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.626273] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-24806e79-03bd-4096-996a-f7834cf9a2f7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.626418] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24806e79-03bd-4096-996a-f7834cf9a2f7',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.825047] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.825047] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.825262] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.825390] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.825522] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.825835] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.825932] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.825996] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.826221] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.826326] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.826437] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b5440d1-45ae-41d0-a9b6-24cc237ec6a2 already deleted. [ 1101.826542] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b5440d1-45ae-41d0-a9b6-24cc237ec6a2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.132029] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.132029] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.132029] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.132029] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.132029] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.132029] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 24806e79-03bd-4096-996a-f7834cf9a2f7 not found, creating... [ 1102.132029] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.132029] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.132029] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.132029] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.132029] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.132580] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.132580] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.132580] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.132580] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.132580] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.132580] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 24806e79-03bd-4096-996a-f7834cf9a2f7 is going to be created. [ 1102.153297] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.153297] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.153297] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.153297] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.153297] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.153297] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-24806e79-03bd-4096-996a-f7834cf9a2f7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.524269] env[68328]: INFO networking_nsxv3.common.synchronization [req-59d9a903-a5a0-49cf-931e-8821c8f96740 req-40dc24d5-160c-4a16-9f12-f6fb6cf8b3c8 tempest-ServerRescueTestJSON-1284245856 tempest-ServerRescueTestJSON-1284245856-project-member] Enqueued Resource ID: fdf99f09-b7da-4a5c-af72-042c6f58dc8e with Priority: HIGHEST for action security_group_members [ 1102.524811] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdf99f09-b7da-4a5c-af72-042c6f58dc8e with Priority: HIGHEST for action security_group_members [ 1102.525141] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.525504] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.525504] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.525628] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.525666] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.525759] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.525817] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.525959] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.527031] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.527189] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fdf99f09-b7da-4a5c-af72-042c6f58dc8e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.031650] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.031650] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.031650] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.031650] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.049276] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.052517] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.052517] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.052517] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.052517] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.052517] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.052517] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdf99f09-b7da-4a5c-af72-042c6f58dc8e is going to be updated. [ 1103.074569] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.074735] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.074804] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.075023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.075774] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.082801] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdf99f09-b7da-4a5c-af72-042c6f58dc8e in Status: IN_PROGRESS for 2s [ 1103.291036] env[68328]: INFO networking_nsxv3.common.synchronization [req-14063a6e-8a40-41be-9d71-9d36e15f5aa6 req-8309d9bc-7bf4-4f60-9e81-d695ada97b5c service nova] Enqueued Resource ID: 1b5440d1-45ae-41d0-a9b6-24cc237ec6a2 with Priority: HIGHEST for action security_group_rules [ 1103.291036] env[68328]: INFO networking_nsxv3.common.synchronization [req-14063a6e-8a40-41be-9d71-9d36e15f5aa6 req-8309d9bc-7bf4-4f60-9e81-d695ada97b5c service nova] Enqueued Resource ID: 1b5440d1-45ae-41d0-a9b6-24cc237ec6a2 with Priority: HIGHEST for action security_group_members [ 1103.291036] env[68328]: INFO networking_nsxv3.common.synchronization [req-14063a6e-8a40-41be-9d71-9d36e15f5aa6 req-8309d9bc-7bf4-4f60-9e81-d695ada97b5c service nova] Enqueued Resource ID: 24806e79-03bd-4096-996a-f7834cf9a2f7 with Priority: HIGHEST for action port [ 1103.291036] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b5440d1-45ae-41d0-a9b6-24cc237ec6a2 with Priority: HIGHEST for action security_group_rules [ 1103.291036] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b5440d1-45ae-41d0-a9b6-24cc237ec6a2 with Priority: HIGHEST for action security_group_members [ 1103.291036] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24806e79-03bd-4096-996a-f7834cf9a2f7 with Priority: HIGHEST for action port [ 1103.291036] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b5440d1-45ae-41d0-a9b6-24cc237ec6a2 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.291036] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b5440d1-45ae-41d0-a9b6-24cc237ec6a2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.291493] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b5440d1-45ae-41d0-a9b6-24cc237ec6a2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.291493] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b5440d1-45ae-41d0-a9b6-24cc237ec6a2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.291493] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b5440d1-45ae-41d0-a9b6-24cc237ec6a2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.292226] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b5440d1-45ae-41d0-a9b6-24cc237ec6a2 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.292337] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b5440d1-45ae-41d0-a9b6-24cc237ec6a2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.292402] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b5440d1-45ae-41d0-a9b6-24cc237ec6a2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.292568] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b5440d1-45ae-41d0-a9b6-24cc237ec6a2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.292707] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.292883] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.292917] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.293085] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.293165] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.293253] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b5440d1-45ae-41d0-a9b6-24cc237ec6a2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.293993] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-24806e79-03bd-4096-996a-f7834cf9a2f7 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.294112] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-24806e79-03bd-4096-996a-f7834cf9a2f7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.294229] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-24806e79-03bd-4096-996a-f7834cf9a2f7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.294334] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-24806e79-03bd-4096-996a-f7834cf9a2f7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.294406] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24806e79-03bd-4096-996a-f7834cf9a2f7',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.795777] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1b5440d1-45ae-41d0-a9b6-24cc237ec6a2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.797088] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b5440d1-45ae-41d0-a9b6-24cc237ec6a2 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.797209] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b5440d1-45ae-41d0-a9b6-24cc237ec6a2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.797348] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 24806e79-03bd-4096-996a-f7834cf9a2f7 with status ACTIVE [ 1103.798072] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.798072] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.798072] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.798072] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.798072] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.798407] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.798407] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.798407] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.798407] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.800279] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.800279] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.800279] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.800279] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.800279] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.800279] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.800279] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 24806e79-03bd-4096-996a-f7834cf9a2f7 is going to be updated. [ 1103.823063] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.823063] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.823063] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.823063] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.823063] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.823063] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-24806e79-03bd-4096-996a-f7834cf9a2f7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.160032] env[68328]: INFO networking_nsxv3.common.synchronization [req-95889b56-3799-4382-a89d-718f3c8612c9 req-dd503258-af1f-447b-a261-067a12943e09 tempest-ServersTestJSON-1771388484 tempest-ServersTestJSON-1771388484-project-member] Enqueued Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_members [ 1104.160560] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_members [ 1104.160867] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-5841566c-1d05-4389-b8a7-950b5f9c6708 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.160987] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.161067] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.161258] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.161404] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.161497] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.161558] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.161695] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.161783] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.161874] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.302399] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1b5440d1-45ae-41d0-a9b6-24cc237ec6a2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.664246] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.805161] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.805430] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.805430] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.805806] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.805806] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.805904] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b5440d1-45ae-41d0-a9b6-24cc237ec6a2 is going to be created. [ 1104.830180] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.830180] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.830180] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.830345] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.830448] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.839056] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b5440d1-45ae-41d0-a9b6-24cc237ec6a2 in Status: UNINITIALIZED for 2s [ 1105.092990] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdf99f09-b7da-4a5c-af72-042c6f58dc8e in Status: SUCCESS [ 1105.092990] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdf99f09-b7da-4a5c-af72-042c6f58dc8e deletion is rescheduled due to dependency. [ 1105.092990] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdf99f09-b7da-4a5c-af72-042c6f58dc8e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.151950] env[68328]: INFO networking_nsxv3.common.synchronization [req-754b18be-8d5d-44c0-b428-20e5d4fbcd5d req-cdfb76ae-10d6-4bb8-8e14-dd9a09ddb2e3 tempest-DeleteServersTestJSON-1696259291 tempest-DeleteServersTestJSON-1696259291-project-member] Enqueued Resource ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 with Priority: HIGHEST for action security_group_members [ 1105.153389] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 with Priority: HIGHEST for action security_group_members [ 1105.153389] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.153389] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.153389] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.153616] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.153733] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.153947] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.154045] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.154636] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.154636] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.154636] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c35aa45-69e7-4952-b5d8-8a7d6b3460e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.166439] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.584725] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-280 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.584980] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-280" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.585123] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-280" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.585412] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-280" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.586071] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.586265] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.586409] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.586653] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.586808] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.587052] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1105.587188] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1105.587310] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1105.587425] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1105.587559] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1105.587672] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1105.587813] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1105.604664] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1105.604849] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1105.604997] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1105.605260] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-280" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.605587] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-ac73b7c6-5ee4-4d74-be45-4c17cdc85ecc taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.605782] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-ac73b7c6-5ee4-4d74-be45-4c17cdc85ecc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.605921] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-ac73b7c6-5ee4-4d74-be45-4c17cdc85ecc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.606274] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-ac73b7c6-5ee4-4d74-be45-4c17cdc85ecc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.606466] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac73b7c6-5ee4-4d74-be45-4c17cdc85ecc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.656864] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.657028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.657109] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.657315] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.657523] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.657579] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.657677] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.657738] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.657883] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.657982] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.658140] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 is going to be updated. [ 1105.667998] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.668139] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.668198] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.668359] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.668440] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.668531] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 is going to be updated. [ 1105.684304] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.684449] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.684489] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.684670] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.684804] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.694567] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 in Status: IN_PROGRESS for 2s [ 1105.698015] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.698203] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.698296] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.698498] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.698656] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.705781] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: IN_PROGRESS for 2s [ 1106.108839] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.109100] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.109237] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.109840] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.110017] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.110219] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port ac73b7c6-5ee4-4d74-be45-4c17cdc85ecc not found, creating... [ 1106.110571] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.111774] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.111774] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.111774] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.111774] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.111774] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.112174] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.112174] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.112375] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.112375] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.113035] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: ac73b7c6-5ee4-4d74-be45-4c17cdc85ecc is going to be created. [ 1106.132258] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.132390] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.132515] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.132761] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.133045] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.133297] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-ac73b7c6-5ee4-4d74-be45-4c17cdc85ecc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.828141] env[68328]: INFO networking_nsxv3.common.synchronization [req-754b18be-8d5d-44c0-b428-20e5d4fbcd5d req-c22df65e-f7f2-4e70-b60d-5d011cc1ff16 service nova] Enqueued Resource ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 with Priority: HIGHEST for action security_group_rules [ 1106.828141] env[68328]: INFO networking_nsxv3.common.synchronization [req-754b18be-8d5d-44c0-b428-20e5d4fbcd5d req-c22df65e-f7f2-4e70-b60d-5d011cc1ff16 service nova] Enqueued Resource ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 with Priority: HIGHEST for action security_group_members [ 1106.828141] env[68328]: INFO networking_nsxv3.common.synchronization [req-754b18be-8d5d-44c0-b428-20e5d4fbcd5d req-c22df65e-f7f2-4e70-b60d-5d011cc1ff16 service nova] Enqueued Resource ID: ac73b7c6-5ee4-4d74-be45-4c17cdc85ecc with Priority: HIGHEST for action port [ 1106.828141] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 with Priority: HIGHEST for action security_group_rules [ 1106.828141] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 with Priority: HIGHEST for action security_group_members [ 1106.828141] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac73b7c6-5ee4-4d74-be45-4c17cdc85ecc with Priority: HIGHEST for action port [ 1106.828141] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.828141] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.828141] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.828141] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.828141] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c35aa45-69e7-4952-b5d8-8a7d6b3460e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.830106] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.830498] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.831202] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac73b7c6-5ee4-4d74-be45-4c17cdc85ecc taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.831489] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac73b7c6-5ee4-4d74-be45-4c17cdc85ecc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.831667] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac73b7c6-5ee4-4d74-be45-4c17cdc85ecc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.832147] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac73b7c6-5ee4-4d74-be45-4c17cdc85ecc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.832921] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac73b7c6-5ee4-4d74-be45-4c17cdc85ecc',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.848459] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b5440d1-45ae-41d0-a9b6-24cc237ec6a2 in Status: SUCCESS [ 1106.848836] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b5440d1-45ae-41d0-a9b6-24cc237ec6a2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.850778] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b5440d1-45ae-41d0-a9b6-24cc237ec6a2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.850778] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b5440d1-45ae-41d0-a9b6-24cc237ec6a2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.850778] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.850778] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.850778] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.850778] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.850778] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.850778] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b5440d1-45ae-41d0-a9b6-24cc237ec6a2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.850778] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1b5440d1-45ae-41d0-a9b6-24cc237ec6a2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.334595] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ac73b7c6-5ee4-4d74-be45-4c17cdc85ecc with status ACTIVE [ 1107.334837] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.334978] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.335062] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.335296] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.335388] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.335568] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.335667] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.335732] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.335876] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.335954] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.336149] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.336241] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.336302] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.336438] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.336519] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.336590] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ac73b7c6-5ee4-4d74-be45-4c17cdc85ecc is going to be updated. [ 1107.338622] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.338622] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.353202] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1b5440d1-45ae-41d0-a9b6-24cc237ec6a2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.356573] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.356697] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.356765] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.356950] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.357094] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.357247] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac73b7c6-5ee4-4d74-be45-4c17cdc85ecc" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.703890] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 in Status: SUCCESS [ 1107.704179] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 deletion is rescheduled due to dependency. [ 1107.704294] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.704451] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.704656] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.704839] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.704952] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.705022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.705178] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.705256] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.705349] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c35aa45-69e7-4952-b5d8-8a7d6b3460e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.716144] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: SUCCESS [ 1107.716144] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.855515] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1b5440d1-45ae-41d0-a9b6-24cc237ec6a2: rpc.has_security_group_logging(os_id): False [ 1107.872125] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.872297] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.872343] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.872583] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.872692] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.872999] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.873143] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.873216] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.873400] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.873505] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.873600] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b5440d1-45ae-41d0-a9b6-24cc237ec6a2 is going to be created. [ 1107.928855] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.928994] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.929133] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.929288] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.929462] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.940108] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1b5440d1-45ae-41d0-a9b6-24cc237ec6a2 in Status: IN_PROGRESS for 2s [ 1108.209567] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7c35aa45-69e7-4952-b5d8-8a7d6b3460e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.713404] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7c35aa45-69e7-4952-b5d8-8a7d6b3460e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.216575] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.217080] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.217080] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.217080] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.217207] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.217207] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 is going to be updated. [ 1109.246164] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.246325] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.246325] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.246535] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.246674] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.254988] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 in Status: IN_PROGRESS for 2s [ 1109.951350] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1b5440d1-45ae-41d0-a9b6-24cc237ec6a2 in Status: SUCCESS [ 1109.951646] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b5440d1-45ae-41d0-a9b6-24cc237ec6a2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.266858] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 in Status: SUCCESS [ 1111.267241] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.267241] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.267455] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.267665] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.267816] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.267902] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.268099] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.268184] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.268273] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.268369] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7c35aa45-69e7-4952-b5d8-8a7d6b3460e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.770730] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.770951] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.770988] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.771236] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.771410] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.771507] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.771569] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.771709] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.771794] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.771882] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.772035] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.772129] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.772184] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.772326] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.772459] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.772557] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.772601] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.772731] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.772803] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.772910] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.772996] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7c35aa45-69e7-4952-b5d8-8a7d6b3460e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.828589] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1111.828589] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1112.275282] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1: rpc.has_security_group_logging(os_id): False [ 1112.293042] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.293042] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.293042] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.293042] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.293042] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.293469] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.293691] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.293843] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.294180] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.295028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.295028] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.295028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.295028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.295291] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.295476] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.295745] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.295947] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.298989] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.298989] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.298989] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.298989] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 is going to be updated. [ 1112.355526] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.355526] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.355526] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.355526] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.355526] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.367727] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 in Status: IN_PROGRESS for 2s [ 1113.134814] env[68328]: INFO networking_nsxv3.common.synchronization [req-10e15ce6-0794-41f9-972f-0419f46bb49f req-f93b3bd6-0357-448b-8302-05f830e23add tempest-AttachInterfacesTestJSON-966841523 tempest-AttachInterfacesTestJSON-966841523-project-member] Enqueued Resource ID: e27762cf-c0f5-443d-8332-584b8241d0be with Priority: HIGHEST for action security_group_members [ 1113.135374] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e27762cf-c0f5-443d-8332-584b8241d0be with Priority: HIGHEST for action security_group_members [ 1113.135687] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-e27762cf-c0f5-443d-8332-584b8241d0be taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.135807] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e27762cf-c0f5-443d-8332-584b8241d0be" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.135874] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e27762cf-c0f5-443d-8332-584b8241d0be" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.140257] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e27762cf-c0f5-443d-8332-584b8241d0be" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.140444] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.140569] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.140632] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.140885] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.141014] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.141014] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e27762cf-c0f5-443d-8332-584b8241d0be',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.467034] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-615 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.467034] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-615" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.467034] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-615" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.467034] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-615" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.467671] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.468056] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.468391] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.468752] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.469133] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.472020] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1113.472020] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1113.472020] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1113.472020] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1113.472020] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1113.472020] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1113.472020] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1113.488682] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1113.488682] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1113.488682] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1113.488682] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-615" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.488917] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-db34d253-6bfc-4b87-8640-a5d0ea69e59c taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.489016] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-db34d253-6bfc-4b87-8640-a5d0ea69e59c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.489140] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-db34d253-6bfc-4b87-8640-a5d0ea69e59c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.489479] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-db34d253-6bfc-4b87-8640-a5d0ea69e59c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.489616] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db34d253-6bfc-4b87-8640-a5d0ea69e59c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.643767] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e27762cf-c0f5-443d-8332-584b8241d0be',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.995726] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.996242] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.996242] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.996443] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.001052] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.001052] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port db34d253-6bfc-4b87-8640-a5d0ea69e59c not found, creating... [ 1114.001052] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.001052] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.001052] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.001052] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.001052] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.001052] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.001052] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.001052] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.002038] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.002038] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.002038] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: db34d253-6bfc-4b87-8640-a5d0ea69e59c is going to be created. [ 1114.024746] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.024990] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.025137] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.025430] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.025686] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.026296] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-db34d253-6bfc-4b87-8640-a5d0ea69e59c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.145642] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e27762cf-c0f5-443d-8332-584b8241d0be',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.380415] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 in Status: SUCCESS [ 1114.380680] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.648465] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.648819] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.648928] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.649244] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.649676] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.649973] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e27762cf-c0f5-443d-8332-584b8241d0be is going to be updated. [ 1114.674740] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.674870] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.674919] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.675502] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.675502] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.683319] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e27762cf-c0f5-443d-8332-584b8241d0be in Status: IN_PROGRESS for 2s [ 1114.745891] env[68328]: INFO networking_nsxv3.common.synchronization [req-10e15ce6-0794-41f9-972f-0419f46bb49f req-29054d86-a6f9-4e7c-88c8-cfdfbb1dd0aa service nova] Enqueued Resource ID: e27762cf-c0f5-443d-8332-584b8241d0be with Priority: HIGHEST for action security_group_rules [ 1114.746173] env[68328]: INFO networking_nsxv3.common.synchronization [req-10e15ce6-0794-41f9-972f-0419f46bb49f req-29054d86-a6f9-4e7c-88c8-cfdfbb1dd0aa service nova] Enqueued Resource ID: e27762cf-c0f5-443d-8332-584b8241d0be with Priority: HIGHEST for action security_group_members [ 1114.746414] env[68328]: INFO networking_nsxv3.common.synchronization [req-10e15ce6-0794-41f9-972f-0419f46bb49f req-29054d86-a6f9-4e7c-88c8-cfdfbb1dd0aa service nova] Enqueued Resource ID: db34d253-6bfc-4b87-8640-a5d0ea69e59c with Priority: HIGHEST for action port [ 1114.747191] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e27762cf-c0f5-443d-8332-584b8241d0be with Priority: HIGHEST for action security_group_rules [ 1114.747337] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e27762cf-c0f5-443d-8332-584b8241d0be with Priority: HIGHEST for action security_group_members [ 1114.747436] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db34d253-6bfc-4b87-8640-a5d0ea69e59c with Priority: HIGHEST for action port [ 1114.747782] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e27762cf-c0f5-443d-8332-584b8241d0be taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.747950] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e27762cf-c0f5-443d-8332-584b8241d0be" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.748020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e27762cf-c0f5-443d-8332-584b8241d0be" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.748229] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e27762cf-c0f5-443d-8332-584b8241d0be" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.748326] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e27762cf-c0f5-443d-8332-584b8241d0be',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.749584] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-e27762cf-c0f5-443d-8332-584b8241d0be taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.749584] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e27762cf-c0f5-443d-8332-584b8241d0be" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.749717] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-db34d253-6bfc-4b87-8640-a5d0ea69e59c taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.749793] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db34d253-6bfc-4b87-8640-a5d0ea69e59c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.749968] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db34d253-6bfc-4b87-8640-a5d0ea69e59c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.750112] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db34d253-6bfc-4b87-8640-a5d0ea69e59c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.750194] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db34d253-6bfc-4b87-8640-a5d0ea69e59c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.252320] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-e27762cf-c0f5-443d-8332-584b8241d0be taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.252450] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e27762cf-c0f5-443d-8332-584b8241d0be" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.252672] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port db34d253-6bfc-4b87-8640-a5d0ea69e59c with status ACTIVE [ 1115.252838] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.252988] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.253099] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.253333] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.253434] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.253644] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.253745] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.253809] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.254009] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.254101] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.254308] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.254418] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.254480] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.254650] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.254752] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.254837] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: db34d253-6bfc-4b87-8640-a5d0ea69e59c is going to be updated. [ 1115.276254] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.276410] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.276471] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.276680] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.276815] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.277046] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db34d253-6bfc-4b87-8640-a5d0ea69e59c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.547403] env[68328]: INFO networking_nsxv3.common.synchronization [req-e9c24a33-f83b-4fd6-a8f7-275f40724187 req-6af31c11-20af-44f1-ba34-bb9f28331741 tempest-ServerDiskConfigTestJSON-155339900 tempest-ServerDiskConfigTestJSON-155339900-project-member] Enqueued Resource ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 with Priority: HIGHEST for action security_group_members [ 1115.548171] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 with Priority: HIGHEST for action security_group_members [ 1115.548329] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-261361c9-81c8-47fa-9a8a-4e37a8a439d7 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.548491] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.548596] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.548830] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.549082] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.549249] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.549656] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.549962] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.549962] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.550415] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('261361c9-81c8-47fa-9a8a-4e37a8a439d7',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.938796] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-754 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.939153] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-754" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.939153] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-754" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.939384] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-754" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.939770] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.939936] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.940097] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.940328] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.940477] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.940693] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1115.940985] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1115.941074] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1115.941163] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1115.941286] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1115.941433] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1115.941539] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1115.959106] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1115.959283] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1115.959427] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1115.959604] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-754" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.959911] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-d9389b4b-e85f-497b-bb96-5a68d0633eee taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.960107] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-d9389b4b-e85f-497b-bb96-5a68d0633eee" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.960245] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-d9389b4b-e85f-497b-bb96-5a68d0633eee" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.960577] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-d9389b4b-e85f-497b-bb96-5a68d0633eee" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.960725] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9389b4b-e85f-497b-bb96-5a68d0633eee',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.052689] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.052915] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.052972] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.053242] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.053347] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.053589] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.053707] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.053782] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.053953] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.054086] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.054213] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 is going to be updated. [ 1116.077644] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.077787] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.077859] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.078506] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.078506] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.086303] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 in Status: IN_PROGRESS for 2s [ 1116.466363] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.466363] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.466363] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.466363] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.466363] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.466363] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port d9389b4b-e85f-497b-bb96-5a68d0633eee not found, creating... [ 1116.466363] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.466363] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.466363] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.466747] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.466787] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.467591] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.467591] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.467591] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.467830] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.468052] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.468264] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: d9389b4b-e85f-497b-bb96-5a68d0633eee is going to be created. [ 1116.486869] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.487072] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.487225] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.487505] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.487749] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.488098] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-d9389b4b-e85f-497b-bb96-5a68d0633eee" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.694209] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e27762cf-c0f5-443d-8332-584b8241d0be in Status: SUCCESS [ 1116.694360] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e27762cf-c0f5-443d-8332-584b8241d0be" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.694534] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e27762cf-c0f5-443d-8332-584b8241d0be" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.694744] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e27762cf-c0f5-443d-8332-584b8241d0be" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.694860] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.694977] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.695124] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.695199] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.695302] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.695444] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e27762cf-c0f5-443d-8332-584b8241d0be',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.170351] env[68328]: INFO networking_nsxv3.common.synchronization [req-e9c24a33-f83b-4fd6-a8f7-275f40724187 req-09496d23-3724-47ce-a501-bfedd3e86c6c service nova] Enqueued Resource ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 with Priority: HIGHEST for action security_group_rules [ 1117.170710] env[68328]: INFO networking_nsxv3.common.synchronization [req-e9c24a33-f83b-4fd6-a8f7-275f40724187 req-09496d23-3724-47ce-a501-bfedd3e86c6c service nova] Enqueued Resource ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 with Priority: HIGHEST for action security_group_members [ 1117.170969] env[68328]: INFO networking_nsxv3.common.synchronization [req-e9c24a33-f83b-4fd6-a8f7-275f40724187 req-09496d23-3724-47ce-a501-bfedd3e86c6c service nova] Enqueued Resource ID: d9389b4b-e85f-497b-bb96-5a68d0633eee with Priority: HIGHEST for action port [ 1117.171690] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 with Priority: HIGHEST for action security_group_rules [ 1117.172615] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 with Priority: HIGHEST for action security_group_members [ 1117.172863] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9389b4b-e85f-497b-bb96-5a68d0633eee with Priority: HIGHEST for action port [ 1117.173672] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-261361c9-81c8-47fa-9a8a-4e37a8a439d7 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.176017] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.176173] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.176807] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.176807] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('261361c9-81c8-47fa-9a8a-4e37a8a439d7',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.178078] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-261361c9-81c8-47fa-9a8a-4e37a8a439d7 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.178078] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.182743] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-d9389b4b-e85f-497b-bb96-5a68d0633eee taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.182743] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d9389b4b-e85f-497b-bb96-5a68d0633eee" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.182743] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d9389b4b-e85f-497b-bb96-5a68d0633eee" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.182743] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d9389b4b-e85f-497b-bb96-5a68d0633eee" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.182743] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9389b4b-e85f-497b-bb96-5a68d0633eee',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.198647] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e27762cf-c0f5-443d-8332-584b8241d0be',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.683458] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-261361c9-81c8-47fa-9a8a-4e37a8a439d7 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.683458] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.683629] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d9389b4b-e85f-497b-bb96-5a68d0633eee with status ACTIVE [ 1117.683856] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.684069] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.684187] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.684438] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.684574] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.684786] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.684944] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.685055] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.685315] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.685828] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.685828] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.685828] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.685828] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.686038] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.686222] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.686361] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d9389b4b-e85f-497b-bb96-5a68d0633eee is going to be updated. [ 1117.701421] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e27762cf-c0f5-443d-8332-584b8241d0be',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.706350] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.706615] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.706735] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.706949] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.707142] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.707344] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d9389b4b-e85f-497b-bb96-5a68d0633eee" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.097896] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 in Status: SUCCESS [ 1118.098257] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 deletion is rescheduled due to dependency. [ 1118.098426] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.098671] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.098983] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.099280] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.099473] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.099588] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.099815] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.099908] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.100080] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('261361c9-81c8-47fa-9a8a-4e37a8a439d7',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.205060] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.205060] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.205060] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.205493] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.205493] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.205493] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e27762cf-c0f5-443d-8332-584b8241d0be is going to be updated. [ 1118.240592] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.240738] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.240810] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.241038] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.241181] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.249944] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e27762cf-c0f5-443d-8332-584b8241d0be in Status: IN_PROGRESS for 2s [ 1118.602026] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('261361c9-81c8-47fa-9a8a-4e37a8a439d7',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.105648] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('261361c9-81c8-47fa-9a8a-4e37a8a439d7',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.609416] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.609693] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.609746] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.610036] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.610137] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.610260] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 is going to be updated. [ 1119.639683] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.639683] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.639913] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.640033] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.640130] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.650784] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 in Status: IN_PROGRESS for 2s [ 1120.200033] env[68328]: INFO networking_nsxv3.common.synchronization [req-6284ed95-7f25-493c-a874-d2a750b2cd9a req-760cc9b5-4a49-4d74-8fc6-ce6dec6fab2a tempest-DeleteServersTestJSON-1696259291 tempest-DeleteServersTestJSON-1696259291-project-member] Enqueued Resource ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 with Priority: HIGHEST for action security_group_members [ 1120.200033] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 with Priority: HIGHEST for action security_group_members [ 1120.200033] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.200033] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.200033] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.200033] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.200033] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.200033] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.200033] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.200033] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.204925] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.206173] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c35aa45-69e7-4952-b5d8-8a7d6b3460e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.259198] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e27762cf-c0f5-443d-8332-584b8241d0be in Status: SUCCESS [ 1120.261560] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e27762cf-c0f5-443d-8332-584b8241d0be" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.261560] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e27762cf-c0f5-443d-8332-584b8241d0be" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.261560] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e27762cf-c0f5-443d-8332-584b8241d0be" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.261560] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.261560] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.261560] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.261560] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.261560] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.261560] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e27762cf-c0f5-443d-8332-584b8241d0be" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.261560] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e27762cf-c0f5-443d-8332-584b8241d0be',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.514709] env[68328]: INFO networking_nsxv3.common.synchronization [None req-85d56421-058e-43b3-b701-919f70359c0a tempest-AttachVolumeTestJSON-972540760 tempest-AttachVolumeTestJSON-972540760-project-member] Enqueued Resource ID: b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724 with Priority: HIGHEST for action security_group_rules [ 1120.515254] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724 with Priority: HIGHEST for action security_group_rules [ 1120.515581] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.515707] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.515777] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.516125] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.516394] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.589552] env[68328]: INFO networking_nsxv3.common.synchronization [None req-039c5da6-bac7-4eb6-a64d-a891de1c48e5 tempest-AttachVolumeTestJSON-972540760 tempest-AttachVolumeTestJSON-972540760-project-member] Enqueued Resource ID: b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724 with Priority: HIGHEST for action security_group_rules [ 1120.590068] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724 with Priority: HIGHEST for action security_group_rules [ 1120.590382] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.590490] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.707085] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.707419] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.707419] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.707524] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.707647] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.707810] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.708193] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.708193] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.708193] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.708193] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.708399] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 is going to be updated. [ 1120.733064] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.733208] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.733311] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.733543] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.733746] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.741895] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 in Status: IN_PROGRESS for 2s [ 1120.764398] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e27762cf-c0f5-443d-8332-584b8241d0be',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.040122] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.040255] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.040326] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.040546] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.040641] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.040726] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724 already deleted. [ 1121.040808] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.041350] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.041526] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.041612] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.267318] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e27762cf-c0f5-443d-8332-584b8241d0be: rpc.has_security_group_logging(os_id): False [ 1121.286497] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.286684] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.286735] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.286921] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.287030] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.287285] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.287389] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.287451] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.287653] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.287790] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.287790] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e27762cf-c0f5-443d-8332-584b8241d0be is going to be updated. [ 1121.341598] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.341792] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.341868] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.342165] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.342317] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.353649] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e27762cf-c0f5-443d-8332-584b8241d0be in Status: IN_PROGRESS for 2s [ 1121.562252] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.564572] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.564572] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.564572] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.564572] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.564727] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724 already deleted. [ 1121.564890] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.662217] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 in Status: SUCCESS [ 1121.662506] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.662756] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.663086] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.663359] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.664139] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.664261] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.664490] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.664623] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.664779] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.664922] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('261361c9-81c8-47fa-9a8a-4e37a8a439d7',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.168407] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-261361c9-81c8-47fa-9a8a-4e37a8a439d7 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.168707] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.168707] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.168915] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.169017] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.169121] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.169187] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.169335] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.169424] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.169508] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.169645] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-261361c9-81c8-47fa-9a8a-4e37a8a439d7 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.169736] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.169796] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.169932] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.170076] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.170171] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.170220] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.170366] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.170420] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.170534] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.170581] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('261361c9-81c8-47fa-9a8a-4e37a8a439d7',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.673039] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 261361c9-81c8-47fa-9a8a-4e37a8a439d7: rpc.has_security_group_logging(os_id): False [ 1122.691217] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.691421] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.691524] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.691825] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.691958] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.692310] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.692477] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.692582] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.692828] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.692953] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.693262] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.693414] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.693512] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.693727] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.693844] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.694161] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.694304] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.694401] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.694966] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.694966] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.694966] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 is going to be updated. [ 1122.752997] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 in Status: SUCCESS [ 1122.752997] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 deletion is rescheduled due to dependency. [ 1122.753175] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.754191] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.754316] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.754435] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.754614] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.754798] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.766600] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 in Status: IN_PROGRESS for 2s [ 1123.366401] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e27762cf-c0f5-443d-8332-584b8241d0be in Status: SUCCESS [ 1123.366678] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e27762cf-c0f5-443d-8332-584b8241d0be" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.778834] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 in Status: SUCCESS [ 1124.779150] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.591444] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1125.591586] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1126.931874] env[68328]: INFO networking_nsxv3.common.synchronization [None req-b0e4e9d2-716a-4f77-8d68-cd3f7019083f tempest-AttachInterfacesTestJSON-966841523 tempest-AttachInterfacesTestJSON-966841523-project-member] Enqueued Resource ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 with Priority: HIGHEST for action security_group_members [ 1126.932350] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 with Priority: HIGHEST for action security_group_members [ 1126.932954] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.933485] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.933547] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.933773] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.934085] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.934204] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.934277] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.934419] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.934509] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.934630] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('398e93bc-b7ea-4684-aa02-2e6ab22c1fe5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.439512] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.439680] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.439752] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.439975] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.440090] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.440299] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.440397] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.440459] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.440610] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.440687] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.440774] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 is going to be deleted. [ 1127.471243] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.471400] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.471543] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.471663] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.471756] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.471853] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.933831] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1131.934220] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1135.369121] env[68328]: INFO networking_nsxv3.common.synchronization [req-116079a6-a8aa-4af8-abd3-3d0654b26041 req-4852ca2c-d69e-44ce-9786-11d31b516355 tempest-AttachVolumeTestJSON-972540760 tempest-AttachVolumeTestJSON-972540760-project-member] Enqueued Resource ID: b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724 with Priority: HIGHEST for action security_group_members [ 1135.369121] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724 with Priority: HIGHEST for action security_group_members [ 1135.369362] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.369469] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.369524] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.369767] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.369917] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.371055] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.371276] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.371363] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.371441] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.371556] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.741256] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-587 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.741488] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-587" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.741625] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-587" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.742290] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-587" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.742762] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.742947] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.743092] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.743357] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.743511] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.743728] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1135.743847] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1135.743959] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1135.744084] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1135.744200] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1135.744311] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1135.744447] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1135.765046] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1135.765433] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1135.765433] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1135.766984] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-587" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.766984] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-236263f4-3d41-43f5-96b0-4fbf33e8df5d taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.766984] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-236263f4-3d41-43f5-96b0-4fbf33e8df5d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.766984] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-236263f4-3d41-43f5-96b0-4fbf33e8df5d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.766984] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-236263f4-3d41-43f5-96b0-4fbf33e8df5d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.767813] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('236263f4-3d41-43f5-96b0-4fbf33e8df5d',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.874700] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.874896] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.874986] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.875268] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.875384] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.875637] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.875754] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.875837] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.876038] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.876136] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.876226] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724 already deleted. [ 1135.876322] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.918796] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-615 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.919024] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-615" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.919159] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-615" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.919424] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-615" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.919701] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.919862] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.919981] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.920209] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.920359] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.920573] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1135.920689] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1135.920799] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1135.920909] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1135.921054] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1135.921203] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1135.921373] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1135.945486] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1135.945663] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1135.945804] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1135.945986] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-615" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.946332] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-3ad908a8-1911-492a-9f06-955fc9b224c6 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.946507] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-3ad908a8-1911-492a-9f06-955fc9b224c6" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.946630] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-3ad908a8-1911-492a-9f06-955fc9b224c6" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.946977] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-3ad908a8-1911-492a-9f06-955fc9b224c6" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.947144] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ad908a8-1911-492a-9f06-955fc9b224c6',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.269985] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.270269] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.270374] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.270669] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.270820] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.270992] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 236263f4-3d41-43f5-96b0-4fbf33e8df5d not found, creating... [ 1136.271307] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.271470] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.271592] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.271822] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.271967] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.273177] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.273177] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.273177] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.273177] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.273177] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.273177] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 236263f4-3d41-43f5-96b0-4fbf33e8df5d is going to be created. [ 1136.292550] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.292850] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.292969] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.293245] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.293764] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.293764] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-236263f4-3d41-43f5-96b0-4fbf33e8df5d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.450653] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.450653] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.450653] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.450653] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.451068] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.451068] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 3ad908a8-1911-492a-9f06-955fc9b224c6 not found, creating... [ 1136.451159] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.451312] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.451436] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.451658] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.451802] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.452109] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.452305] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.452397] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.452754] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.452931] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.453150] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 3ad908a8-1911-492a-9f06-955fc9b224c6 is going to be created. [ 1136.477254] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.477506] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.477681] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.477961] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.478248] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.478509] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-3ad908a8-1911-492a-9f06-955fc9b224c6" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.568100] env[68328]: INFO networking_nsxv3.common.synchronization [req-aeb20871-831c-4e3a-ad31-481103f8d75d req-e685ad05-b2bf-4f29-99bb-5d1cc13213a2 tempest-ServerActionsTestOtherB-24837534 tempest-ServerActionsTestOtherB-24837534-project-member] Enqueued Resource ID: 54390b69-5280-4540-a63f-fa4daae4a11f with Priority: HIGHEST for action security_group_members [ 1136.568683] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54390b69-5280-4540-a63f-fa4daae4a11f with Priority: HIGHEST for action security_group_members [ 1136.568992] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-54390b69-5280-4540-a63f-fa4daae4a11f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.569132] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.569201] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.569437] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.569592] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.569705] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.569742] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.570140] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.570140] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.570140] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54390b69-5280-4540-a63f-fa4daae4a11f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.026404] env[68328]: INFO networking_nsxv3.common.synchronization [req-116079a6-a8aa-4af8-abd3-3d0654b26041 req-49e0ad44-0538-4358-9469-54d6a25df72b service nova] Enqueued Resource ID: b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724 with Priority: HIGHEST for action security_group_rules [ 1137.026404] env[68328]: INFO networking_nsxv3.common.synchronization [req-116079a6-a8aa-4af8-abd3-3d0654b26041 req-49e0ad44-0538-4358-9469-54d6a25df72b service nova] Enqueued Resource ID: b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724 with Priority: HIGHEST for action security_group_members [ 1137.026404] env[68328]: INFO networking_nsxv3.common.synchronization [req-116079a6-a8aa-4af8-abd3-3d0654b26041 req-49e0ad44-0538-4358-9469-54d6a25df72b service nova] Enqueued Resource ID: 236263f4-3d41-43f5-96b0-4fbf33e8df5d with Priority: HIGHEST for action port [ 1137.026404] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724 with Priority: HIGHEST for action security_group_rules [ 1137.026404] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724 with Priority: HIGHEST for action security_group_members [ 1137.026404] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 236263f4-3d41-43f5-96b0-4fbf33e8df5d with Priority: HIGHEST for action port [ 1137.026404] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.026404] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.026404] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.026404] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.026404] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.027903] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.028179] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.031190] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.031190] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.031190] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.031190] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.031190] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.031190] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.031190] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.031190] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.031885] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-236263f4-3d41-43f5-96b0-4fbf33e8df5d taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.031885] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-236263f4-3d41-43f5-96b0-4fbf33e8df5d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.032944] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-236263f4-3d41-43f5-96b0-4fbf33e8df5d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.034757] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-236263f4-3d41-43f5-96b0-4fbf33e8df5d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.034757] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('236263f4-3d41-43f5-96b0-4fbf33e8df5d',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.074262] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.074262] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.074262] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.074262] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.094776] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.094776] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.094776] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.094776] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.094776] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.094776] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.094776] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54390b69-5280-4540-a63f-fa4daae4a11f is going to be updated. [ 1137.119646] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.120209] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.120416] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.120868] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.121157] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.128542] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54390b69-5280-4540-a63f-fa4daae4a11f in Status: IN_PROGRESS for 2s [ 1137.179312] env[68328]: INFO networking_nsxv3.common.synchronization [req-d7a9f733-fbd2-4ce9-b262-d74512d9b4dc req-3bd6551b-de99-4e10-aa5b-4e233832e7e9 service nova] Enqueued Resource ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 with Priority: HIGHEST for action security_group_rules [ 1137.179312] env[68328]: INFO networking_nsxv3.common.synchronization [req-d7a9f733-fbd2-4ce9-b262-d74512d9b4dc req-3bd6551b-de99-4e10-aa5b-4e233832e7e9 service nova] Enqueued Resource ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 with Priority: HIGHEST for action security_group_members [ 1137.179312] env[68328]: INFO networking_nsxv3.common.synchronization [req-d7a9f733-fbd2-4ce9-b262-d74512d9b4dc req-3bd6551b-de99-4e10-aa5b-4e233832e7e9 service nova] Enqueued Resource ID: 3ad908a8-1911-492a-9f06-955fc9b224c6 with Priority: HIGHEST for action port [ 1137.179312] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 with Priority: HIGHEST for action security_group_rules [ 1137.179312] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 with Priority: HIGHEST for action security_group_members [ 1137.179312] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ad908a8-1911-492a-9f06-955fc9b224c6 with Priority: HIGHEST for action port [ 1137.179312] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.181394] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.181394] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.181394] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.181494] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('398e93bc-b7ea-4684-aa02-2e6ab22c1fe5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.182347] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.182466] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.182466] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.183238] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.183238] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.183238] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.183238] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.183238] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.183238] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.183238] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('398e93bc-b7ea-4684-aa02-2e6ab22c1fe5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.183984] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ad908a8-1911-492a-9f06-955fc9b224c6 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.184742] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ad908a8-1911-492a-9f06-955fc9b224c6" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.184816] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ad908a8-1911-492a-9f06-955fc9b224c6" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.184970] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ad908a8-1911-492a-9f06-955fc9b224c6" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.185057] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ad908a8-1911-492a-9f06-955fc9b224c6',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.535317] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.537114] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.537114] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.537114] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 236263f4-3d41-43f5-96b0-4fbf33e8df5d with status ACTIVE [ 1137.537114] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.537114] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.537114] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.537114] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.537506] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.537506] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.537506] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.537506] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.537709] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.537709] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.537885] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.538717] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.538786] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.538957] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.539055] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.539358] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 236263f4-3d41-43f5-96b0-4fbf33e8df5d is going to be updated. [ 1137.562557] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.562557] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.562557] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.562557] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.562557] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.562557] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-236263f4-3d41-43f5-96b0-4fbf33e8df5d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.687050] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.687050] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.687050] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('398e93bc-b7ea-4684-aa02-2e6ab22c1fe5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.688060] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3ad908a8-1911-492a-9f06-955fc9b224c6 with status ACTIVE [ 1137.688318] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.688493] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.688613] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.688904] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.689059] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.689298] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.689456] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.689563] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.689814] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.689949] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.690595] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.690595] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.690595] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.690812] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.690812] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.690904] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3ad908a8-1911-492a-9f06-955fc9b224c6 is going to be updated. [ 1137.713634] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.713760] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.713824] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.714020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.714172] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.714341] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ad908a8-1911-492a-9f06-955fc9b224c6" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.041397] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.193347] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('398e93bc-b7ea-4684-aa02-2e6ab22c1fe5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.543981] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.544313] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.544355] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.544587] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.544676] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.544776] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724 is going to be created. [ 1138.566431] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.566566] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.566602] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.566803] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.566957] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.575818] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724 in Status: UNINITIALIZED for 2s [ 1138.695306] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.695457] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.695534] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.695752] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.695845] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.696232] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 is going to be created. [ 1138.717155] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.717300] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.717355] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.717561] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.717718] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.727016] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 in Status: UNINITIALIZED for 2s [ 1139.137318] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54390b69-5280-4540-a63f-fa4daae4a11f in Status: IN_PROGRESS for 4s [ 1139.970502] env[68328]: INFO networking_nsxv3.common.synchronization [req-1a830730-5db7-489c-a1bd-4bee7f2cda4d req-cc8d91e5-92f8-4029-bc94-f50e7a1ef856 tempest-ServersTestJSON-1771388484 tempest-ServersTestJSON-1771388484-project-member] Enqueued Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_members [ 1139.970502] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_members [ 1139.970502] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-5841566c-1d05-4389-b8a7-950b5f9c6708 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.970813] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.970813] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.970813] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.970934] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.971121] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.971240] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.971478] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.971603] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.971734] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.236231] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-384 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.236468] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-384" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.237077] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-384" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.237077] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-384" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.237379] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.237379] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.237469] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.237694] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.237967] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.240493] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1140.240493] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1140.240493] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1140.240493] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1140.240493] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1140.240493] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1140.240493] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1140.257864] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1140.258070] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1140.258219] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1140.258402] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-384" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.258713] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-ebe540e7-4e89-43b1-a45b-ba5d0fd21711 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.258881] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-ebe540e7-4e89-43b1-a45b-ba5d0fd21711" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.259010] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-ebe540e7-4e89-43b1-a45b-ba5d0fd21711" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.259344] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-ebe540e7-4e89-43b1-a45b-ba5d0fd21711" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.259489] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebe540e7-4e89-43b1-a45b-ba5d0fd21711',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.473479] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.585924] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724 in Status: SUCCESS [ 1140.586187] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.586377] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.586615] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.586842] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.586981] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.587269] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.587269] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.587397] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.587467] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.587532] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.737163] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 in Status: SUCCESS [ 1140.737449] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.737654] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.737906] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.738147] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.738318] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.738397] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.738562] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.738648] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.738734] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.738828] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('398e93bc-b7ea-4684-aa02-2e6ab22c1fe5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.761987] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.762242] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.762405] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.762676] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.762829] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.762989] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port ebe540e7-4e89-43b1-a45b-ba5d0fd21711 not found, creating... [ 1140.763301] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.763506] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.763634] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.763879] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.764045] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.764351] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.764522] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.764645] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.764860] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.764999] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.765173] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: ebe540e7-4e89-43b1-a45b-ba5d0fd21711 is going to be created. [ 1140.792127] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.792365] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.792513] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.792816] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.793057] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.793334] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-ebe540e7-4e89-43b1-a45b-ba5d0fd21711" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.975532] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.092930] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.147493] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54390b69-5280-4540-a63f-fa4daae4a11f in Status: SUCCESS [ 1141.147713] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54390b69-5280-4540-a63f-fa4daae4a11f deletion is rescheduled due to dependency. [ 1141.147866] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.241033] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.241200] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.241200] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.241546] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.241585] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.241756] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.241756] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.241975] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.242113] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.242417] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.242417] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.242530] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.242530] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.242754] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.242895] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.243126] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.243126] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.243208] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.243892] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.243892] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.243892] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('398e93bc-b7ea-4684-aa02-2e6ab22c1fe5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.470306] env[68328]: INFO networking_nsxv3.common.synchronization [req-1a830730-5db7-489c-a1bd-4bee7f2cda4d req-ba5fb52d-9a47-4c08-b5c1-f1a056639294 service nova] Enqueued Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_rules [ 1141.470524] env[68328]: INFO networking_nsxv3.common.synchronization [req-1a830730-5db7-489c-a1bd-4bee7f2cda4d req-ba5fb52d-9a47-4c08-b5c1-f1a056639294 service nova] Enqueued Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_members [ 1141.470669] env[68328]: INFO networking_nsxv3.common.synchronization [req-1a830730-5db7-489c-a1bd-4bee7f2cda4d req-ba5fb52d-9a47-4c08-b5c1-f1a056639294 service nova] Enqueued Resource ID: ebe540e7-4e89-43b1-a45b-ba5d0fd21711 with Priority: HIGHEST for action port [ 1141.471196] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_rules [ 1141.471356] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_members [ 1141.471455] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebe540e7-4e89-43b1-a45b-ba5d0fd21711 with Priority: HIGHEST for action port [ 1141.471721] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5841566c-1d05-4389-b8a7-950b5f9c6708 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.471836] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.471901] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.472302] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.472387] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.473433] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-5841566c-1d05-4389-b8a7-950b5f9c6708 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.474028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.474028] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-ebe540e7-4e89-43b1-a45b-ba5d0fd21711 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.474028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ebe540e7-4e89-43b1-a45b-ba5d0fd21711" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.474028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ebe540e7-4e89-43b1-a45b-ba5d0fd21711" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.474287] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ebe540e7-4e89-43b1-a45b-ba5d0fd21711" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.474287] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebe540e7-4e89-43b1-a45b-ba5d0fd21711',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.477849] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.477946] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.478017] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.478249] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.478360] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.478451] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 is going to be updated. [ 1141.504455] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.504660] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.504752] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.504967] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.505181] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.513179] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: IN_PROGRESS for 2s [ 1141.596154] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724: rpc.has_security_group_logging(os_id): False [ 1141.612806] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.612973] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.613072] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.613487] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.613487] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.613734] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.613844] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.613916] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.614101] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.614201] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.614302] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724 is going to be created. [ 1141.675639] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.675826] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.675976] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.676092] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.676279] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.685787] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724 in Status: IN_PROGRESS for 2s [ 1141.746930] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5: rpc.has_security_group_logging(os_id): False [ 1141.766335] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.766493] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.766548] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.766748] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.766837] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.767039] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.767171] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.767228] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.767423] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.767507] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.767705] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.767798] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.767855] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.769986] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.769986] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.769986] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.769986] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.769986] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.769986] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.769986] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.769986] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 is going to be created. [ 1141.850075] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.850075] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.850075] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.850075] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.850307] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.862533] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 in Status: IN_PROGRESS for 2s [ 1141.975662] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-5841566c-1d05-4389-b8a7-950b5f9c6708 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.976166] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.976166] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ebe540e7-4e89-43b1-a45b-ba5d0fd21711 with status ACTIVE [ 1141.976166] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.976306] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.976360] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.976565] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.976654] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.976823] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.976919] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.976989] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.977231] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.977231] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.977382] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.977475] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.977533] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.977669] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.977742] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.977823] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ebe540e7-4e89-43b1-a45b-ba5d0fd21711 is going to be updated. [ 1142.006112] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.006260] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.006320] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.006596] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.006645] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.006811] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ebe540e7-4e89-43b1-a45b-ba5d0fd21711" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.522612] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: SUCCESS [ 1143.522612] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.523060] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.523060] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.523169] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.523353] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.523416] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.523583] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.523664] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.523758] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.697659] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724 in Status: SUCCESS [ 1143.697884] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.874079] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 in Status: SUCCESS [ 1143.874306] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.026390] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.528323] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.033018] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.033018] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.033018] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.033018] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.033018] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.033018] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 is going to be updated. [ 1145.039065] env[68328]: INFO networking_nsxv3.common.synchronization [req-365f804b-ea8e-4e5f-b601-c1487c1c5a35 req-5dd1812b-1804-4084-bbd2-8bd3551ead2d tempest-ServerActionsTestJSON-719988657 tempest-ServerActionsTestJSON-719988657-project-member] Enqueued Resource ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 with Priority: HIGHEST for action security_group_members [ 1145.039600] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 with Priority: HIGHEST for action security_group_members [ 1145.039900] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.040023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.040086] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.040304] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.040419] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.040509] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.040661] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.040840] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.040919] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.041763] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8024e0cc-9eaa-4282-b00c-9e9b1de030e2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.057827] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.057966] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.058048] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.058251] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.058394] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.066314] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: IN_PROGRESS for 2s [ 1145.481232] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-194 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.481428] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-194" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.481561] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-194" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.481839] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-194" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.482118] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.482351] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.482490] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.482711] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.482860] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.483325] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1145.487019] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1145.487019] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1145.487019] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1145.487019] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1145.487019] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1145.487019] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1145.501202] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1145.501411] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1145.501559] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1145.501735] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-194" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.502080] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-8ce900df-4c92-47b2-a21e-bd310cf26c5d taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.502314] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-8ce900df-4c92-47b2-a21e-bd310cf26c5d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.502463] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-8ce900df-4c92-47b2-a21e-bd310cf26c5d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.502730] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-8ce900df-4c92-47b2-a21e-bd310cf26c5d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.502881] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ce900df-4c92-47b2-a21e-bd310cf26c5d',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.543891] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.544210] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.544210] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.544566] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.563022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.563147] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.564109] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.564109] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.564109] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.564109] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.564109] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 is going to be updated. [ 1145.587246] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.587406] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.587447] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.587628] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.587755] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.595417] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 in Status: IN_PROGRESS for 2s [ 1146.005339] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.005823] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.005997] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.006356] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.006561] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.006929] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.007141] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.007271] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.007524] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.007674] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.007996] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.008178] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.008300] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.008574] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.008724] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.008872] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 8ce900df-4c92-47b2-a21e-bd310cf26c5d is going to be updated. [ 1146.029571] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.029800] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.029959] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.030354] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.030562] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.030802] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-8ce900df-4c92-47b2-a21e-bd310cf26c5d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.745650] env[68328]: INFO networking_nsxv3.common.synchronization [req-882acab3-dc64-496f-9fe7-b080375159eb req-9373e798-4edb-4bc5-965d-d6ea7a51b6a1 service nova] Enqueued Resource ID: 551b86cb-6c17-4238-9ac7-89fd77e1e91b with Priority: HIGHEST for action security_group_rules [ 1146.746008] env[68328]: INFO networking_nsxv3.common.synchronization [req-882acab3-dc64-496f-9fe7-b080375159eb req-9373e798-4edb-4bc5-965d-d6ea7a51b6a1 service nova] Enqueued Resource ID: 551b86cb-6c17-4238-9ac7-89fd77e1e91b with Priority: HIGHEST for action security_group_members [ 1146.746284] env[68328]: INFO networking_nsxv3.common.synchronization [req-882acab3-dc64-496f-9fe7-b080375159eb req-9373e798-4edb-4bc5-965d-d6ea7a51b6a1 service nova] Enqueued Resource ID: 8ce900df-4c92-47b2-a21e-bd310cf26c5d with Priority: HIGHEST for action port [ 1146.746825] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 551b86cb-6c17-4238-9ac7-89fd77e1e91b with Priority: HIGHEST for action security_group_rules [ 1146.746961] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 551b86cb-6c17-4238-9ac7-89fd77e1e91b with Priority: HIGHEST for action security_group_members [ 1146.747069] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ce900df-4c92-47b2-a21e-bd310cf26c5d with Priority: HIGHEST for action port [ 1146.747348] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-551b86cb-6c17-4238-9ac7-89fd77e1e91b taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.747468] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-551b86cb-6c17-4238-9ac7-89fd77e1e91b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.747534] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-551b86cb-6c17-4238-9ac7-89fd77e1e91b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.747731] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-551b86cb-6c17-4238-9ac7-89fd77e1e91b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.747804] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('551b86cb-6c17-4238-9ac7-89fd77e1e91b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.748623] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-551b86cb-6c17-4238-9ac7-89fd77e1e91b taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.748728] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-551b86cb-6c17-4238-9ac7-89fd77e1e91b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.748795] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-551b86cb-6c17-4238-9ac7-89fd77e1e91b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.749116] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-551b86cb-6c17-4238-9ac7-89fd77e1e91b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.749286] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.749405] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.749486] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.749667] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.749756] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.753189] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('551b86cb-6c17-4238-9ac7-89fd77e1e91b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.753964] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ce900df-4c92-47b2-a21e-bd310cf26c5d taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.754093] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ce900df-4c92-47b2-a21e-bd310cf26c5d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.754135] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ce900df-4c92-47b2-a21e-bd310cf26c5d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.758018] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ce900df-4c92-47b2-a21e-bd310cf26c5d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.758018] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ce900df-4c92-47b2-a21e-bd310cf26c5d',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.075782] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: SUCCESS [ 1147.076056] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.076247] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.076485] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.076707] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.076841] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.076921] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.077133] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.077236] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.077337] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.077437] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.255819] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-551b86cb-6c17-4238-9ac7-89fd77e1e91b taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.256096] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-551b86cb-6c17-4238-9ac7-89fd77e1e91b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.256178] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('551b86cb-6c17-4238-9ac7-89fd77e1e91b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.260027] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8ce900df-4c92-47b2-a21e-bd310cf26c5d with status ACTIVE [ 1147.260364] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.260565] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.260686] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.261010] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.261187] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.261475] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.261652] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.261757] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.262031] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.262202] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.262491] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.262662] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.262784] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.263031] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.263178] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.263397] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8ce900df-4c92-47b2-a21e-bd310cf26c5d is going to be updated. [ 1147.283644] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.283802] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.283937] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.284276] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.284497] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.284753] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ce900df-4c92-47b2-a21e-bd310cf26c5d" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.579934] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-5841566c-1d05-4389-b8a7-950b5f9c6708 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.580108] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.580197] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.580582] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.580695] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.580793] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.580854] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.581012] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.581127] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.581237] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.581419] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-5841566c-1d05-4389-b8a7-950b5f9c6708 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.581541] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.581579] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.581709] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.581863] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.581955] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.582026] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.582191] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.582266] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.582353] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.582447] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.604968] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 in Status: SUCCESS [ 1147.605237] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 deletion is rescheduled due to dependency. [ 1147.605393] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.758270] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('551b86cb-6c17-4238-9ac7-89fd77e1e91b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.084723] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5841566c-1d05-4389-b8a7-950b5f9c6708: rpc.has_security_group_logging(os_id): False [ 1148.103062] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.103217] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.103217] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.103486] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.103611] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.104341] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.104341] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.104341] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.104341] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.104565] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.104616] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.104727] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.104798] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.104966] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.105065] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.105274] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.105392] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.105459] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.105619] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.105715] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.105822] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 is going to be updated. [ 1148.177383] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.177571] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.177571] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.177729] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.177870] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.194330] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: IN_PROGRESS for 2s [ 1148.260905] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.261082] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.261186] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.261498] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.261594] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.261712] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 551b86cb-6c17-4238-9ac7-89fd77e1e91b is going to be updated. [ 1148.301049] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.301049] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.301049] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.301049] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.301493] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.310520] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 551b86cb-6c17-4238-9ac7-89fd77e1e91b in Status: IN_PROGRESS for 2s [ 1148.496967] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-188 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.496967] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-188" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.496967] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-188" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.496967] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-188" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.496967] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.496967] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.497555] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.497882] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.498145] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.498465] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1148.498679] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1148.498892] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1148.499102] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1148.499396] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1148.499598] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1148.499819] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1148.518626] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1148.518812] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1148.518956] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1148.519169] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-188" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.519491] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-8bb3756c-995f-4283-8751-79df76d83d16 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.519665] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-8bb3756c-995f-4283-8751-79df76d83d16" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.519792] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-8bb3756c-995f-4283-8751-79df76d83d16" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.520062] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-8bb3756c-995f-4283-8751-79df76d83d16" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.520206] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8bb3756c-995f-4283-8751-79df76d83d16',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.023432] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.023750] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.023799] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.024097] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.024255] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.024548] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.024710] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.024832] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.025063] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.025208] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.025492] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.025654] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.025772] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.025980] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.026132] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.026277] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 8bb3756c-995f-4283-8751-79df76d83d16 is going to be updated. [ 1149.045508] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.045769] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.045849] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.046122] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.046338] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.046579] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-8bb3756c-995f-4283-8751-79df76d83d16" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.817575] env[68328]: INFO networking_nsxv3.common.synchronization [req-64f2e0f3-3b21-45a5-ae9a-0e1844330f4e req-54355e1f-6889-47c5-8dfb-b1ea2b5488ea service nova] Enqueued Resource ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f with Priority: HIGHEST for action security_group_rules [ 1149.817764] env[68328]: INFO networking_nsxv3.common.synchronization [req-64f2e0f3-3b21-45a5-ae9a-0e1844330f4e req-54355e1f-6889-47c5-8dfb-b1ea2b5488ea service nova] Enqueued Resource ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f with Priority: HIGHEST for action security_group_members [ 1149.817919] env[68328]: INFO networking_nsxv3.common.synchronization [req-64f2e0f3-3b21-45a5-ae9a-0e1844330f4e req-54355e1f-6889-47c5-8dfb-b1ea2b5488ea service nova] Enqueued Resource ID: 8bb3756c-995f-4283-8751-79df76d83d16 with Priority: HIGHEST for action port [ 1149.818207] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f with Priority: HIGHEST for action security_group_rules [ 1149.818339] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f with Priority: HIGHEST for action security_group_members [ 1149.818438] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bb3756c-995f-4283-8751-79df76d83d16 with Priority: HIGHEST for action port [ 1149.818981] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f0bcdd73-03e5-43ee-a623-9ac2490cee8f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.819306] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.819351] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.819515] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.819594] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f0bcdd73-03e5-43ee-a623-9ac2490cee8f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.822269] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.822269] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.822269] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.822269] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.822269] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.822269] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.822269] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.822269] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.822269] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.822269] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0bcdd73-03e5-43ee-a623-9ac2490cee8f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.822726] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-8bb3756c-995f-4283-8751-79df76d83d16 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.822726] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8bb3756c-995f-4283-8751-79df76d83d16" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.822726] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8bb3756c-995f-4283-8751-79df76d83d16" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.822726] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8bb3756c-995f-4283-8751-79df76d83d16" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.823068] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8bb3756c-995f-4283-8751-79df76d83d16',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.216139] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: SUCCESS [ 1150.216496] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.320815] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 551b86cb-6c17-4238-9ac7-89fd77e1e91b in Status: SUCCESS [ 1150.321048] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-551b86cb-6c17-4238-9ac7-89fd77e1e91b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.321230] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-551b86cb-6c17-4238-9ac7-89fd77e1e91b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.321470] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-551b86cb-6c17-4238-9ac7-89fd77e1e91b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.321657] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.321771] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.321836] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.321980] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.322079] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.322164] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-551b86cb-6c17-4238-9ac7-89fd77e1e91b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.322261] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('551b86cb-6c17-4238-9ac7-89fd77e1e91b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.324842] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f0bcdd73-03e5-43ee-a623-9ac2490cee8f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.325596] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.325684] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.325852] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8bb3756c-995f-4283-8751-79df76d83d16 with status ACTIVE [ 1150.326009] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.326117] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.326226] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.326332] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.326413] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.326574] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.326665] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.326726] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.326863] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.326938] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.327124] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.327216] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.327278] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.327411] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.328576] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.328576] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8bb3756c-995f-4283-8751-79df76d83d16 is going to be updated. [ 1150.349023] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.349172] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.349245] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.349442] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.349577] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.349731] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8bb3756c-995f-4283-8751-79df76d83d16" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.824797] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('551b86cb-6c17-4238-9ac7-89fd77e1e91b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.829705] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f0bcdd73-03e5-43ee-a623-9ac2490cee8f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.838140] env[68328]: INFO networking_nsxv3.common.synchronization [req-f7263473-6f83-494e-9a0b-906d1ec412b1 req-2d21e9a8-5f6f-4d45-a356-af109d267f6e tempest-ServersTestFqdnHostnames-31007644 tempest-ServersTestFqdnHostnames-31007644-project-member] Enqueued Resource ID: b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2 with Priority: HIGHEST for action security_group_members [ 1150.838632] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2 with Priority: HIGHEST for action security_group_members [ 1150.839329] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.839488] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.839551] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.839758] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.839915] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.840031] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.840101] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.840240] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.840592] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.840592] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.327286] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 551b86cb-6c17-4238-9ac7-89fd77e1e91b: rpc.has_security_group_logging(os_id): False [ 1151.332225] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.332978] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.332978] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.332978] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.332978] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.332978] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f is going to be updated. [ 1151.343555] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.343787] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.343901] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.344182] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.347241] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.347404] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.361769] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.361978] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.362075] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.362283] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.362425] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.372301] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f in Status: IN_PROGRESS for 2s [ 1151.373391] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.373662] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.373770] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.373850] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.374072] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.374161] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.374252] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2 is going to be updated. [ 1151.375258] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.375456] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.396893] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.396893] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.396893] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.398469] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.398656] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.398754] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.398859] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 551b86cb-6c17-4238-9ac7-89fd77e1e91b is going to be updated. [ 1151.407907] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.408061] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.408136] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.408433] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.408585] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.420685] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2 in Status: IN_PROGRESS for 2s [ 1151.458302] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.458452] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.458567] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.458765] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.458857] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.475136] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 551b86cb-6c17-4238-9ac7-89fd77e1e91b in Status: IN_PROGRESS for 2s [ 1153.382425] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f in Status: SUCCESS [ 1153.382887] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.382887] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.383176] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.383475] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.383560] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.383634] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.383831] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.383929] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.384062] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.384177] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f0bcdd73-03e5-43ee-a623-9ac2490cee8f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.430258] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2 in Status: SUCCESS [ 1153.430433] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2 deletion is rescheduled due to dependency. [ 1153.430547] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.487995] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 551b86cb-6c17-4238-9ac7-89fd77e1e91b in Status: SUCCESS [ 1153.488267] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-551b86cb-6c17-4238-9ac7-89fd77e1e91b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.887603] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.887763] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.887763] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.887994] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.888191] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.888297] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.888362] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.888516] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.888603] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.888691] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.888839] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.888961] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.889034] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.889172] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.889352] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.889421] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.889452] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.889591] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.889670] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.889752] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.889845] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f0bcdd73-03e5-43ee-a623-9ac2490cee8f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.392366] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f0bcdd73-03e5-43ee-a623-9ac2490cee8f: rpc.has_security_group_logging(os_id): False [ 1154.410703] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.410945] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.411051] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.411366] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.411476] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.411773] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.411881] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.411971] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.412157] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.412239] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.412428] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.412524] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.412585] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.412768] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.412902] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.413091] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.413193] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.413259] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.413433] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.413511] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.413591] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f is going to be updated. [ 1154.471536] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.471733] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.471733] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.472057] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.472341] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.486932] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f in Status: IN_PROGRESS for 2s [ 1154.914573] env[68328]: INFO networking_nsxv3.common.synchronization [req-775a0887-dd01-458c-aa08-bc59283c940a req-aa558f68-d1d3-44b7-b2a4-1907793b4feb tempest-DeleteServersTestJSON-1696259291 tempest-DeleteServersTestJSON-1696259291-project-member] Enqueued Resource ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 with Priority: HIGHEST for action security_group_members [ 1154.914573] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 with Priority: HIGHEST for action security_group_members [ 1154.914573] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.914573] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.914573] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.914573] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.914573] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.914573] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.914573] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.914573] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.914573] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.914573] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c35aa45-69e7-4952-b5d8-8a7d6b3460e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.237390] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-280 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.237390] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-280" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.237390] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-280" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.237390] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-280" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.237390] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.237390] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.237390] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.237390] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.237935] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.237935] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1155.237935] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1155.238105] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1155.238577] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1155.238577] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1155.238577] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1155.238735] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1155.266640] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1155.266852] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1155.267013] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1155.267272] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-280" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.267669] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-83a2f9a1-7b55-437a-9be4-31c2bf914405 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.267903] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-83a2f9a1-7b55-437a-9be4-31c2bf914405" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.267997] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-83a2f9a1-7b55-437a-9be4-31c2bf914405" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.268388] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-83a2f9a1-7b55-437a-9be4-31c2bf914405" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.268652] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83a2f9a1-7b55-437a-9be4-31c2bf914405',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.416213] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.416502] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.416502] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.417921] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.417921] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.417921] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.417921] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.417921] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.417921] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.417921] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.417921] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 is going to be updated. [ 1155.445118] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.445331] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.445433] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.445689] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.445888] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.455867] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 in Status: IN_PROGRESS for 2s [ 1155.774794] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.775131] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.775335] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.775717] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.775898] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.776094] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 83a2f9a1-7b55-437a-9be4-31c2bf914405 not found, creating... [ 1155.776407] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.776580] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.776705] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.776950] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.777141] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.777475] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.777725] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.777845] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.778079] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.778261] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.778421] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 83a2f9a1-7b55-437a-9be4-31c2bf914405 is going to be created. [ 1155.797062] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.797331] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.797494] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.797798] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.798074] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.798336] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-83a2f9a1-7b55-437a-9be4-31c2bf914405" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.512670] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f in Status: SUCCESS [ 1156.513076] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.585991] env[68328]: INFO networking_nsxv3.common.synchronization [req-775a0887-dd01-458c-aa08-bc59283c940a req-108c23af-2ad3-46b5-aa31-1e0fa9f186a4 service nova] Enqueued Resource ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 with Priority: HIGHEST for action security_group_rules [ 1156.586255] env[68328]: INFO networking_nsxv3.common.synchronization [req-775a0887-dd01-458c-aa08-bc59283c940a req-108c23af-2ad3-46b5-aa31-1e0fa9f186a4 service nova] Enqueued Resource ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 with Priority: HIGHEST for action security_group_members [ 1156.586326] env[68328]: INFO networking_nsxv3.common.synchronization [req-775a0887-dd01-458c-aa08-bc59283c940a req-108c23af-2ad3-46b5-aa31-1e0fa9f186a4 service nova] Enqueued Resource ID: 83a2f9a1-7b55-437a-9be4-31c2bf914405 with Priority: HIGHEST for action port [ 1156.586993] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 with Priority: HIGHEST for action security_group_rules [ 1156.587214] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 with Priority: HIGHEST for action security_group_members [ 1156.587436] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83a2f9a1-7b55-437a-9be4-31c2bf914405 with Priority: HIGHEST for action port [ 1156.587803] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.588011] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.588146] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.588398] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.588670] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c35aa45-69e7-4952-b5d8-8a7d6b3460e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.590036] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.590036] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.590036] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-83a2f9a1-7b55-437a-9be4-31c2bf914405 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.590243] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83a2f9a1-7b55-437a-9be4-31c2bf914405" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.590316] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83a2f9a1-7b55-437a-9be4-31c2bf914405" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.590621] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83a2f9a1-7b55-437a-9be4-31c2bf914405" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.590717] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83a2f9a1-7b55-437a-9be4-31c2bf914405',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.093049] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.093049] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.093334] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 83a2f9a1-7b55-437a-9be4-31c2bf914405 with status ACTIVE [ 1157.093465] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.093675] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.093675] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.094061] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.094290] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.094432] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.094595] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.094680] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.094876] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.094969] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.095228] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.095323] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.095388] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.095641] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.095641] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.095782] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 83a2f9a1-7b55-437a-9be4-31c2bf914405 is going to be updated. [ 1157.116235] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.116235] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.116235] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.116595] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.116630] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.116810] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83a2f9a1-7b55-437a-9be4-31c2bf914405" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.466028] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 in Status: SUCCESS [ 1157.466362] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 deletion is rescheduled due to dependency. [ 1157.466362] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.466556] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.466796] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.466987] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.467122] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.467180] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.467349] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.467434] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.467531] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c35aa45-69e7-4952-b5d8-8a7d6b3460e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.476897] env[68328]: INFO networking_nsxv3.common.synchronization [req-98973004-d125-40fa-9ce9-cdc2550f1da3 req-47b27f6f-8e35-4ea4-90ea-8469ad884778 tempest-ServersTestJSON-1771388484 tempest-ServersTestJSON-1771388484-project-member] Enqueued Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_members [ 1157.478539] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_members [ 1157.478539] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-5841566c-1d05-4389-b8a7-950b5f9c6708 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.478799] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.478799] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.479038] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.479259] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.479259] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.479259] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.479450] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.479593] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.479641] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.966027] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-384 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.966027] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-384" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.966027] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-384" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.966027] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-384" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.966027] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.966027] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.966027] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.966027] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.966027] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.966027] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1157.966739] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1157.966895] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1157.967031] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1157.967160] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1157.967270] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1157.967694] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1157.972608] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7c35aa45-69e7-4952-b5d8-8a7d6b3460e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.985618] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1157.985821] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1157.985982] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1157.986179] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-384" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.986505] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-b015f513-4e05-4ead-8b2a-8d79a5472971 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.986687] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-b015f513-4e05-4ead-8b2a-8d79a5472971" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.986812] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-b015f513-4e05-4ead-8b2a-8d79a5472971" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.987215] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-b015f513-4e05-4ead-8b2a-8d79a5472971" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.987366] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b015f513-4e05-4ead-8b2a-8d79a5472971',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.992062] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.475356] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7c35aa45-69e7-4952-b5d8-8a7d6b3460e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.490446] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.490634] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.490787] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.491141] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.491436] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.491786] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port b015f513-4e05-4ead-8b2a-8d79a5472971 not found, creating... [ 1158.492324] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.492558] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.492732] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.493114] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.493324] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.493979] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.494113] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.494154] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.494393] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.494539] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.494762] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: b015f513-4e05-4ead-8b2a-8d79a5472971 is going to be created. [ 1158.496458] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.519096] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.519205] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.519405] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.519759] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.520112] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.520469] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-b015f513-4e05-4ead-8b2a-8d79a5472971" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.977961] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.978261] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.978261] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.978515] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.978603] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.978707] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 is going to be updated. [ 1158.998982] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.999112] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.999200] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.999393] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.999482] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.999580] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 is going to be updated. [ 1159.013138] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.013268] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.013339] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.013557] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.013693] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.023071] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 in Status: IN_PROGRESS for 2s [ 1159.030347] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.030493] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.030551] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.030716] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.030845] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.040887] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: IN_PROGRESS for 2s [ 1159.328892] env[68328]: INFO networking_nsxv3.common.synchronization [req-98973004-d125-40fa-9ce9-cdc2550f1da3 req-727b201e-5ffa-439a-af38-89d06c638417 service nova] Enqueued Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_rules [ 1159.329101] env[68328]: INFO networking_nsxv3.common.synchronization [req-98973004-d125-40fa-9ce9-cdc2550f1da3 req-727b201e-5ffa-439a-af38-89d06c638417 service nova] Enqueued Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_members [ 1159.329271] env[68328]: INFO networking_nsxv3.common.synchronization [req-98973004-d125-40fa-9ce9-cdc2550f1da3 req-727b201e-5ffa-439a-af38-89d06c638417 service nova] Enqueued Resource ID: b015f513-4e05-4ead-8b2a-8d79a5472971 with Priority: HIGHEST for action port [ 1159.329472] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_rules [ 1159.329600] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_members [ 1159.329696] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b015f513-4e05-4ead-8b2a-8d79a5472971 with Priority: HIGHEST for action port [ 1159.330239] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5841566c-1d05-4389-b8a7-950b5f9c6708 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.330360] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.330450] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.330618] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.330698] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.331902] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-5841566c-1d05-4389-b8a7-950b5f9c6708 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.331902] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.331902] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-b015f513-4e05-4ead-8b2a-8d79a5472971 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.332061] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b015f513-4e05-4ead-8b2a-8d79a5472971" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.332061] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b015f513-4e05-4ead-8b2a-8d79a5472971" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.332190] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b015f513-4e05-4ead-8b2a-8d79a5472971" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.332259] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b015f513-4e05-4ead-8b2a-8d79a5472971',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.834242] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-5841566c-1d05-4389-b8a7-950b5f9c6708 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.834394] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.837264] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b015f513-4e05-4ead-8b2a-8d79a5472971 with status ACTIVE [ 1159.837264] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.837384] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.837431] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.837641] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.837734] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.837926] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.838052] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.838837] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.838837] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.838837] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.838837] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.838837] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.838837] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.838837] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.838837] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.839161] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b015f513-4e05-4ead-8b2a-8d79a5472971 is going to be updated. [ 1159.858766] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.859065] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.859065] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.859167] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.859296] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.859461] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b015f513-4e05-4ead-8b2a-8d79a5472971" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.032473] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 in Status: SUCCESS [ 1161.032822] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.032860] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.033126] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.033764] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.033764] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.033764] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.033910] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.033910] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.033984] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.034091] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7c35aa45-69e7-4952-b5d8-8a7d6b3460e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.048932] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: SUCCESS [ 1161.049176] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.049627] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.049846] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.050040] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.050160] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.050225] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.050391] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.050473] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.050566] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.195715] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-615 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.195916] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-615" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.196094] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-615" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.196431] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-615" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.196765] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.197692] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.197692] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.197692] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.197692] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.198039] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1161.198039] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1161.198239] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1161.198304] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1161.199028] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1161.199028] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1161.199028] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1161.217935] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1161.218163] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1161.218311] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1161.218502] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-615" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.218845] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-3ad908a8-1911-492a-9f06-955fc9b224c6 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.219038] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-3ad908a8-1911-492a-9f06-955fc9b224c6" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.219166] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-3ad908a8-1911-492a-9f06-955fc9b224c6" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.219509] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-3ad908a8-1911-492a-9f06-955fc9b224c6" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.219658] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ad908a8-1911-492a-9f06-955fc9b224c6',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.538139] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.538308] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.538387] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.538648] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.538798] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.538901] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.538966] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.539158] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.539215] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.539304] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.539449] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.539541] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.539601] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.539739] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.539880] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.539970] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.540040] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.540178] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.540337] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.540337] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.540499] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7c35aa45-69e7-4952-b5d8-8a7d6b3460e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.554419] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.721962] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.722431] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.722512] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.722784] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.723510] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.723510] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.723777] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.723777] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.723940] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.724097] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.724401] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.724603] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.724725] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.724942] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.725720] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.725720] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 3ad908a8-1911-492a-9f06-955fc9b224c6 is going to be updated. [ 1161.747083] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.747434] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.750923] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.750923] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.750923] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.750923] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-3ad908a8-1911-492a-9f06-955fc9b224c6" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.043740] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1: rpc.has_security_group_logging(os_id): False [ 1162.061659] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.070197] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.070367] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.070442] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.070657] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.070750] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.070975] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.071087] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.071203] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.071302] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.071493] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.071681] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.071775] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.071836] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.072105] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.072105] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.072276] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.072369] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.072484] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.072566] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.072663] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.073780] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 is going to be updated. [ 1162.154382] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.154643] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.154921] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.155904] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.155904] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.168217] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 in Status: IN_PROGRESS for 2s [ 1162.564306] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.564478] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.564654] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.564835] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.564835] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.565026] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 is going to be updated. [ 1162.593403] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.593632] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.593705] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.594503] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.594503] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.602744] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: IN_PROGRESS for 2s [ 1162.616643] env[68328]: INFO networking_nsxv3.common.synchronization [None req-a57d8f8c-42cc-4ac4-9bc4-957dde2983eb tempest-ServerDiskConfigTestJSON-155339900 tempest-ServerDiskConfigTestJSON-155339900-project-member] Enqueued Resource ID: ea620520-ba18-4300-8394-b6b061d8ca72 with Priority: HIGHEST for action security_group_rules [ 1162.617284] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea620520-ba18-4300-8394-b6b061d8ca72 with Priority: HIGHEST for action security_group_rules [ 1162.617613] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea620520-ba18-4300-8394-b6b061d8ca72 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.617814] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea620520-ba18-4300-8394-b6b061d8ca72" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.617898] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea620520-ba18-4300-8394-b6b061d8ca72" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.618848] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea620520-ba18-4300-8394-b6b061d8ca72" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.618941] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea620520-ba18-4300-8394-b6b061d8ca72',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.628913] env[68328]: INFO networking_nsxv3.common.synchronization [req-9b51fac1-039d-45f2-87a1-80dca629173e req-701cb1f1-c8bd-4fdf-bae0-80b1aebb4648 service nova] Enqueued Resource ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 with Priority: HIGHEST for action security_group_rules [ 1162.629192] env[68328]: INFO networking_nsxv3.common.synchronization [req-9b51fac1-039d-45f2-87a1-80dca629173e req-701cb1f1-c8bd-4fdf-bae0-80b1aebb4648 service nova] Enqueued Resource ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 with Priority: HIGHEST for action security_group_members [ 1162.629307] env[68328]: INFO networking_nsxv3.common.synchronization [req-9b51fac1-039d-45f2-87a1-80dca629173e req-701cb1f1-c8bd-4fdf-bae0-80b1aebb4648 service nova] Enqueued Resource ID: 3ad908a8-1911-492a-9f06-955fc9b224c6 with Priority: HIGHEST for action port [ 1162.629781] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 with Priority: HIGHEST for action security_group_rules [ 1162.629933] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 with Priority: HIGHEST for action security_group_members [ 1162.630829] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ad908a8-1911-492a-9f06-955fc9b224c6 with Priority: HIGHEST for action port [ 1162.631212] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.631295] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.631347] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.631572] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.632819] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('398e93bc-b7ea-4684-aa02-2e6ab22c1fe5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.632819] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.633235] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.633235] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.633235] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.633879] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.633967] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.634068] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.634218] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.634367] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.634432] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('398e93bc-b7ea-4684-aa02-2e6ab22c1fe5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.635213] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ad908a8-1911-492a-9f06-955fc9b224c6 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.635310] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ad908a8-1911-492a-9f06-955fc9b224c6" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.635392] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ad908a8-1911-492a-9f06-955fc9b224c6" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.635544] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ad908a8-1911-492a-9f06-955fc9b224c6" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.635630] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ad908a8-1911-492a-9f06-955fc9b224c6',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.758987] env[68328]: INFO networking_nsxv3.common.synchronization [None req-9f951737-d15b-4047-996d-09094a7e6422 tempest-ServerDiskConfigTestJSON-155339900 tempest-ServerDiskConfigTestJSON-155339900-project-member] Enqueued Resource ID: ea620520-ba18-4300-8394-b6b061d8ca72 with Priority: HIGHEST for action security_group_rules [ 1162.758987] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea620520-ba18-4300-8394-b6b061d8ca72 with Priority: HIGHEST for action security_group_rules [ 1162.758987] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea620520-ba18-4300-8394-b6b061d8ca72 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.758987] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea620520-ba18-4300-8394-b6b061d8ca72" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.137605] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.137964] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.137964] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.138047] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.138128] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.138222] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea620520-ba18-4300-8394-b6b061d8ca72 already deleted. [ 1163.138305] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea620520-ba18-4300-8394-b6b061d8ca72" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.138451] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea620520-ba18-4300-8394-b6b061d8ca72" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.138606] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea620520-ba18-4300-8394-b6b061d8ca72" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.138688] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea620520-ba18-4300-8394-b6b061d8ca72',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.139599] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('398e93bc-b7ea-4684-aa02-2e6ab22c1fe5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.143179] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.143179] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.143179] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3ad908a8-1911-492a-9f06-955fc9b224c6 with status ACTIVE [ 1163.143179] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.143179] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.143179] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.143179] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.143179] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.143179] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.143179] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.143179] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.143179] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.143179] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.143953] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.143953] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.144477] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.144477] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.144477] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.144736] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3ad908a8-1911-492a-9f06-955fc9b224c6 is going to be updated. [ 1163.173165] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.173331] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.173370] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.173634] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.173872] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.174101] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ad908a8-1911-492a-9f06-955fc9b224c6" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.643433] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('398e93bc-b7ea-4684-aa02-2e6ab22c1fe5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.659948] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.660196] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.660196] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.660415] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.660509] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.660623] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea620520-ba18-4300-8394-b6b061d8ca72 already deleted. [ 1163.660702] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea620520-ba18-4300-8394-b6b061d8ca72" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.145736] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.146077] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.146077] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.146530] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.146530] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.146530] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 is going to be updated. [ 1164.175220] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.175766] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.175766] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.175766] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.175961] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.182108] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 in Status: SUCCESS [ 1164.182323] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.183617] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 in Status: IN_PROGRESS for 2s [ 1164.314144] env[68328]: INFO networking_nsxv3.common.synchronization [req-d2c1d072-4513-419b-b8d1-6ca0ce9d2666 req-c141ec13-6459-404e-904a-3d099ff563ae tempest-ServerActionsTestJSON-719988657 tempest-ServerActionsTestJSON-719988657-project-member] Enqueued Resource ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 with Priority: HIGHEST for action security_group_members [ 1164.314144] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 with Priority: HIGHEST for action security_group_members [ 1164.314144] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.314144] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.314144] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.314144] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.314144] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.315444] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.316286] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.316681] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.317525] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.317838] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8024e0cc-9eaa-4282-b00c-9e9b1de030e2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.613549] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: SUCCESS [ 1164.613549] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.613549] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.613549] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.613836] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.614104] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.614234] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.614510] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.614654] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.614794] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.614944] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.654233] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-74 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.654233] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-74" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.654233] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-74" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.654828] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-74" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.655419] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.655834] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.658238] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.658238] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.658238] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.658238] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1164.658238] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1164.658238] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1164.658238] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1164.658238] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1164.658238] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1164.660078] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1164.683094] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1164.683094] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1164.683094] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1164.683094] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-74" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.683094] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-a26aa94c-aa1a-4433-bb5c-eecdf81d42a5 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.683094] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-a26aa94c-aa1a-4433-bb5c-eecdf81d42a5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.683094] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-a26aa94c-aa1a-4433-bb5c-eecdf81d42a5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.683094] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-a26aa94c-aa1a-4433-bb5c-eecdf81d42a5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.683421] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a26aa94c-aa1a-4433-bb5c-eecdf81d42a5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.819993] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.820325] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.820325] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.820536] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.820644] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.820868] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.820966] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.821032] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.821192] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.821268] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.821352] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 is going to be updated. [ 1164.850326] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.850540] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.850580] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.852291] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.852291] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.865022] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 in Status: IN_PROGRESS for 2s [ 1164.869115] env[68328]: INFO networking_nsxv3.common.synchronization [None req-c1e1e8c9-4b52-40c7-ba45-55aaa0362b24 None None] Enqueued Resource ID: 12d385dc-5483-4920-8a96-64f0690a3352 with Priority: HIGHEST for action port [ 1164.869386] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12d385dc-5483-4920-8a96-64f0690a3352 with Priority: HIGHEST for action port [ 1164.870084] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-12d385dc-5483-4920-8a96-64f0690a3352 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.870171] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12d385dc-5483-4920-8a96-64f0690a3352" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.870240] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12d385dc-5483-4920-8a96-64f0690a3352" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.870521] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12d385dc-5483-4920-8a96-64f0690a3352" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.870604] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12d385dc-5483-4920-8a96-64f0690a3352',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.118335] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-5841566c-1d05-4389-b8a7-950b5f9c6708 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.118815] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.118944] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.119574] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.119574] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.119574] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.119793] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.119867] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.119996] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.120110] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.120193] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-5841566c-1d05-4389-b8a7-950b5f9c6708 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.120279] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.120350] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.120493] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.120658] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.120753] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.120828] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.120992] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.121088] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.121166] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.121260] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.186544] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.187065] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.187065] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.187285] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.189644] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.189644] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port a26aa94c-aa1a-4433-bb5c-eecdf81d42a5 not found, creating... [ 1165.189644] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.189644] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.189644] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.189644] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.189644] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.189644] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.189644] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.191072] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.191072] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.191072] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.191072] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: a26aa94c-aa1a-4433-bb5c-eecdf81d42a5 is going to be created. [ 1165.214124] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.214124] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.214124] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.214412] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.214563] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.214887] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-a26aa94c-aa1a-4433-bb5c-eecdf81d42a5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.381023] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 12d385dc-5483-4920-8a96-64f0690a3352 [ 1165.381023] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.381023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.381023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.381023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.381023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.381023] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:12d385dc-5483-4920-8a96-64f0690a3352 already deleted. [ 1165.381023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12d385dc-5483-4920-8a96-64f0690a3352" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.624174] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5841566c-1d05-4389-b8a7-950b5f9c6708: rpc.has_security_group_logging(os_id): False [ 1165.644137] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.644502] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.644585] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.644820] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.644907] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.645151] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.645241] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.646671] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.646671] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.646671] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.646671] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.646671] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.646671] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.646671] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.646671] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.646671] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.646671] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.646671] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.646671] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.646671] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.647372] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 is going to be updated. [ 1165.705066] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.705279] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.705279] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.705482] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.705625] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.720181] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: IN_PROGRESS for 2s [ 1166.007195] env[68328]: INFO networking_nsxv3.common.synchronization [req-7e68dd67-4412-44dc-8195-ba76bfbc8758 req-149a6022-ccf7-43b4-a6c5-b269a0c0b297 tempest-ServerDiskConfigTestJSON-155339900 tempest-ServerDiskConfigTestJSON-155339900-project-member] Enqueued Resource ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 with Priority: HIGHEST for action security_group_members [ 1166.007814] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 with Priority: HIGHEST for action security_group_members [ 1166.008197] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-261361c9-81c8-47fa-9a8a-4e37a8a439d7 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.008663] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.008663] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.008663] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.008801] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.011473] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.011550] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.011693] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.011778] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.011873] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('261361c9-81c8-47fa-9a8a-4e37a8a439d7',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.124185] env[68328]: INFO networking_nsxv3.common.synchronization [req-d2c1d072-4513-419b-b8d1-6ca0ce9d2666 req-532708d3-550d-4ce9-b7ad-4a83b1719fe0 service nova] Enqueued Resource ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 with Priority: HIGHEST for action security_group_rules [ 1166.124185] env[68328]: INFO networking_nsxv3.common.synchronization [req-d2c1d072-4513-419b-b8d1-6ca0ce9d2666 req-532708d3-550d-4ce9-b7ad-4a83b1719fe0 service nova] Enqueued Resource ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 with Priority: HIGHEST for action security_group_members [ 1166.124185] env[68328]: INFO networking_nsxv3.common.synchronization [req-d2c1d072-4513-419b-b8d1-6ca0ce9d2666 req-532708d3-550d-4ce9-b7ad-4a83b1719fe0 service nova] Enqueued Resource ID: a26aa94c-aa1a-4433-bb5c-eecdf81d42a5 with Priority: HIGHEST for action port [ 1166.124185] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 with Priority: HIGHEST for action security_group_rules [ 1166.124185] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 with Priority: HIGHEST for action security_group_members [ 1166.124185] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a26aa94c-aa1a-4433-bb5c-eecdf81d42a5 with Priority: HIGHEST for action port [ 1166.124185] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8024e0cc-9eaa-4282-b00c-9e9b1de030e2 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.124185] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.124185] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.124185] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.127589] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8024e0cc-9eaa-4282-b00c-9e9b1de030e2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.128303] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.128303] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.128424] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-a26aa94c-aa1a-4433-bb5c-eecdf81d42a5 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.128521] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a26aa94c-aa1a-4433-bb5c-eecdf81d42a5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.128570] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a26aa94c-aa1a-4433-bb5c-eecdf81d42a5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.128751] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a26aa94c-aa1a-4433-bb5c-eecdf81d42a5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.128830] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a26aa94c-aa1a-4433-bb5c-eecdf81d42a5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.203920] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 in Status: SUCCESS [ 1166.204181] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.204329] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.204552] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.204779] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.204886] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.204950] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.205139] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.205222] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.205326] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.205419] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('398e93bc-b7ea-4684-aa02-2e6ab22c1fe5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.520342] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.520342] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.520519] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.520648] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.520764] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.521020] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.521170] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.521257] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.521499] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.521611] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.521735] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 is going to be updated. [ 1166.598993] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.599152] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.599221] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.599490] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.599581] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.607641] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 in Status: IN_PROGRESS for 2s [ 1166.630259] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.630411] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.630633] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a26aa94c-aa1a-4433-bb5c-eecdf81d42a5 with status ACTIVE [ 1166.630907] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.631057] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.631205] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.631537] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.631690] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.632022] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.632186] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.632296] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.632548] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.632731] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.633100] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.633198] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.633334] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.633563] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.633708] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.633892] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a26aa94c-aa1a-4433-bb5c-eecdf81d42a5 is going to be updated. [ 1166.676930] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.677125] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.677125] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.677317] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.677450] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.677611] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a26aa94c-aa1a-4433-bb5c-eecdf81d42a5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.708532] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.708696] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.708765] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.708981] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.709157] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.709252] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.709606] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.709606] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.709606] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.709606] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.709779] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.709826] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.709878] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.710025] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.710160] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.710243] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.710298] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.710428] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.710506] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.710616] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.710662] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('398e93bc-b7ea-4684-aa02-2e6ab22c1fe5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.828107] env[68328]: INFO networking_nsxv3.common.synchronization [req-9239e4cd-1a6b-4551-bb07-ed9f27f1fb39 req-14d97f76-fdc2-487f-9913-a56877cbcd76 tempest-ServerActionsTestOtherB-24837534 tempest-ServerActionsTestOtherB-24837534-project-member] Enqueued Resource ID: 54390b69-5280-4540-a63f-fa4daae4a11f with Priority: HIGHEST for action security_group_members [ 1166.828876] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54390b69-5280-4540-a63f-fa4daae4a11f with Priority: HIGHEST for action security_group_members [ 1166.829985] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-54390b69-5280-4540-a63f-fa4daae4a11f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.830192] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.832883] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.832883] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.832883] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.832883] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.832883] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.832883] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.832883] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.832883] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54390b69-5280-4540-a63f-fa4daae4a11f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.877203] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 in Status: SUCCESS [ 1166.877203] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 deletion is rescheduled due to dependency. [ 1166.877203] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.877203] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.877203] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.877203] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.877203] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.877203] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.877203] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.877203] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.877203] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8024e0cc-9eaa-4282-b00c-9e9b1de030e2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.879106] env[68328]: INFO networking_nsxv3.common.synchronization [None req-3e7ff3a8-3b14-40be-9e64-422b0f6dd0d3 None None] Enqueued Resource ID: e10df50c-8390-48d9-a572-690c819743fa with Priority: HIGHEST for action port [ 1166.879721] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e10df50c-8390-48d9-a572-690c819743fa with Priority: HIGHEST for action port [ 1166.881318] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-e10df50c-8390-48d9-a572-690c819743fa taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.881318] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e10df50c-8390-48d9-a572-690c819743fa" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.881318] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e10df50c-8390-48d9-a572-690c819743fa" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.881318] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e10df50c-8390-48d9-a572-690c819743fa" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.881318] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e10df50c-8390-48d9-a572-690c819743fa',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.167789] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-507 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.167987] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-507" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.168131] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-507" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.168392] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-507" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.168657] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.168812] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.168928] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.169299] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.169533] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.169796] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1167.170039] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1167.170260] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1167.171906] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1167.171906] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1167.171906] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1167.172969] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1167.192624] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1167.193195] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1167.193195] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1167.193195] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-507" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.193822] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-d093a406-4d0f-4144-977e-071093bee75f taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.194085] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-d093a406-4d0f-4144-977e-071093bee75f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.194282] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-d093a406-4d0f-4144-977e-071093bee75f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.194683] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-d093a406-4d0f-4144-977e-071093bee75f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.194923] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d093a406-4d0f-4144-977e-071093bee75f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.215839] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5: rpc.has_security_group_logging(os_id): False [ 1167.234662] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.235000] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.235636] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.236283] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.236283] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.236375] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.236487] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.236553] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.236724] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.236804] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.237014] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.237372] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.237466] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.237647] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.238119] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.238119] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.238119] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.238119] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.238353] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.238450] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.238567] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 is going to be updated. [ 1167.300951] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.305292] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.305417] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.305692] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.305866] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.321792] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 in Status: IN_PROGRESS for 2s [ 1167.335406] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.335553] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.335635] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.335878] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.336103] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.336221] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.336418] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.338230] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.338230] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.338230] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.338230] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54390b69-5280-4540-a63f-fa4daae4a11f is going to be updated. [ 1167.374980] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.375148] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.375253] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.375518] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.375585] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.381027] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8024e0cc-9eaa-4282-b00c-9e9b1de030e2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.383232] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e10df50c-8390-48d9-a572-690c819743fa [ 1167.383675] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.383675] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.383675] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.383884] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.383983] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.384101] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e10df50c-8390-48d9-a572-690c819743fa already deleted. [ 1167.384187] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e10df50c-8390-48d9-a572-690c819743fa" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.385137] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54390b69-5280-4540-a63f-fa4daae4a11f in Status: IN_PROGRESS for 2s [ 1167.697192] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.697434] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.697563] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.697858] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.698019] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.698183] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port d093a406-4d0f-4144-977e-071093bee75f not found, creating... [ 1167.698449] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.698610] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.698733] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.698955] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.699113] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.699474] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.699660] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.699784] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.700294] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.700502] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.700675] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: d093a406-4d0f-4144-977e-071093bee75f is going to be created. [ 1167.728951] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.729206] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.729410] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.729746] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.730068] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.730316] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-d093a406-4d0f-4144-977e-071093bee75f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.743874] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: SUCCESS [ 1167.744091] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.883613] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8024e0cc-9eaa-4282-b00c-9e9b1de030e2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.385835] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.386108] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.386108] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.386298] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.386392] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.386493] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 is going to be updated. [ 1168.410525] env[68328]: INFO networking_nsxv3.common.synchronization [req-9239e4cd-1a6b-4551-bb07-ed9f27f1fb39 req-7e0ecd42-e758-4963-a328-6848833f40e7 service nova] Enqueued Resource ID: 54390b69-5280-4540-a63f-fa4daae4a11f with Priority: HIGHEST for action security_group_rules [ 1168.410525] env[68328]: INFO networking_nsxv3.common.synchronization [req-9239e4cd-1a6b-4551-bb07-ed9f27f1fb39 req-7e0ecd42-e758-4963-a328-6848833f40e7 service nova] Enqueued Resource ID: 54390b69-5280-4540-a63f-fa4daae4a11f with Priority: HIGHEST for action security_group_members [ 1168.410677] env[68328]: INFO networking_nsxv3.common.synchronization [req-9239e4cd-1a6b-4551-bb07-ed9f27f1fb39 req-7e0ecd42-e758-4963-a328-6848833f40e7 service nova] Enqueued Resource ID: d093a406-4d0f-4144-977e-071093bee75f with Priority: HIGHEST for action port [ 1168.411497] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54390b69-5280-4540-a63f-fa4daae4a11f with Priority: HIGHEST for action security_group_rules [ 1168.411497] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54390b69-5280-4540-a63f-fa4daae4a11f with Priority: HIGHEST for action security_group_members [ 1168.411497] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d093a406-4d0f-4144-977e-071093bee75f with Priority: HIGHEST for action port [ 1168.411608] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54390b69-5280-4540-a63f-fa4daae4a11f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.411891] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.411891] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.411978] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.411978] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54390b69-5280-4540-a63f-fa4daae4a11f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.414087] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-54390b69-5280-4540-a63f-fa4daae4a11f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.414148] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.414369] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-d093a406-4d0f-4144-977e-071093bee75f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.414474] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d093a406-4d0f-4144-977e-071093bee75f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.414697] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d093a406-4d0f-4144-977e-071093bee75f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.414804] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d093a406-4d0f-4144-977e-071093bee75f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.414804] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d093a406-4d0f-4144-977e-071093bee75f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.417572] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.417689] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.417758] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.418337] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.418496] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.428512] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 in Status: IN_PROGRESS for 2s [ 1168.617971] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 in Status: SUCCESS [ 1168.617971] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 deletion is rescheduled due to dependency. [ 1168.617971] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.918251] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-54390b69-5280-4540-a63f-fa4daae4a11f taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.918251] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.920462] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d093a406-4d0f-4144-977e-071093bee75f with status ACTIVE [ 1168.920657] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.920776] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.920846] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.921081] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.921176] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.921351] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.921456] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.921515] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.921669] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.921746] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.921931] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.922054] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.923091] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.923091] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.923091] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.923091] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d093a406-4d0f-4144-977e-071093bee75f is going to be updated. [ 1168.943153] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.943374] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.943661] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.943728] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.944292] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.944292] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d093a406-4d0f-4144-977e-071093bee75f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.213186] env[68328]: INFO networking_nsxv3.common.synchronization [req-32e398cf-fcf1-4181-b12a-45a67635e502 req-8f665ec0-480d-458c-8614-c17f82eadab7 tempest-ServerDiskConfigTestJSON-155339900 tempest-ServerDiskConfigTestJSON-155339900-project-member] Enqueued Resource ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 with Priority: HIGHEST for action security_group_members [ 1169.213598] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 with Priority: HIGHEST for action security_group_members [ 1169.213930] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-261361c9-81c8-47fa-9a8a-4e37a8a439d7 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.215048] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.216188] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.216410] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.216595] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.216706] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.216771] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.216939] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.217038] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.217149] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('261361c9-81c8-47fa-9a8a-4e37a8a439d7',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.337433] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 in Status: SUCCESS [ 1169.337917] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.394721] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54390b69-5280-4540-a63f-fa4daae4a11f in Status: SUCCESS [ 1169.395250] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54390b69-5280-4540-a63f-fa4daae4a11f deletion is rescheduled due to dependency. [ 1169.395250] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.395419] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.395750] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.396023] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.396198] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.396303] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.396548] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.396687] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.396840] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54390b69-5280-4540-a63f-fa4daae4a11f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.726304] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.726304] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.726304] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.726304] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.726304] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.726304] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.726304] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.726304] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.726304] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.726304] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.726304] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 is going to be updated. [ 1169.764395] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.764649] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.764788] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.765185] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.765418] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.774682] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 in Status: IN_PROGRESS for 2s [ 1169.805603] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-754 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.806397] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-754" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.806397] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-754" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.806397] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-754" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.807476] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.807476] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.807476] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.807476] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.807622] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.807809] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1169.807952] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1169.808087] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1169.808205] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1169.808324] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1169.808435] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1169.808577] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1169.826062] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1169.826245] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1169.826392] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1169.826634] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-754" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.827041] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-df09884b-c9da-4108-b85b-46c0de736c1e taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.827256] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-df09884b-c9da-4108-b85b-46c0de736c1e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.827390] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-df09884b-c9da-4108-b85b-46c0de736c1e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.827712] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-df09884b-c9da-4108-b85b-46c0de736c1e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.827861] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df09884b-c9da-4108-b85b-46c0de736c1e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.904032] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('54390b69-5280-4540-a63f-fa4daae4a11f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.331535] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.331788] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.331921] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.332247] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.332409] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.332573] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port df09884b-c9da-4108-b85b-46c0de736c1e not found, creating... [ 1170.332846] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.333015] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.333143] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.333377] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.333567] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.333900] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.334049] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.334175] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.334392] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.334608] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.334782] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: df09884b-c9da-4108-b85b-46c0de736c1e is going to be created. [ 1170.354957] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.355185] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.355330] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.355592] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.355820] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.356081] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-df09884b-c9da-4108-b85b-46c0de736c1e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.405901] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('54390b69-5280-4540-a63f-fa4daae4a11f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.443241] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 in Status: SUCCESS [ 1170.443462] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.443699] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.443944] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.444160] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.444432] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.444432] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.444657] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.444657] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.444738] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.444777] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8024e0cc-9eaa-4282-b00c-9e9b1de030e2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.908560] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.908712] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.908818] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.909017] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.909120] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.909221] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54390b69-5280-4540-a63f-fa4daae4a11f is going to be updated. [ 1170.911973] env[68328]: INFO networking_nsxv3.common.synchronization [req-253699e6-b7d2-4e80-b42a-983439dd3b1b req-18ee7c28-94c8-452c-aa3e-b0d14cb73d66 tempest-DeleteServersTestJSON-1696259291 tempest-DeleteServersTestJSON-1696259291-project-member] Enqueued Resource ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 with Priority: HIGHEST for action security_group_members [ 1170.912894] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 with Priority: HIGHEST for action security_group_members [ 1170.913242] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.913361] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.913419] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.913769] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.913944] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.914064] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.914129] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.914289] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.914743] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.914743] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c35aa45-69e7-4952-b5d8-8a7d6b3460e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.078694] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.078884] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.078946] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.079225] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.079367] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.080566] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8024e0cc-9eaa-4282-b00c-9e9b1de030e2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.091764] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54390b69-5280-4540-a63f-fa4daae4a11f in Status: IN_PROGRESS for 2s [ 1171.257686] env[68328]: INFO networking_nsxv3.common.synchronization [req-32e398cf-fcf1-4181-b12a-45a67635e502 req-ac6e93f2-4388-45c3-9c55-9b884de282ec service nova] Enqueued Resource ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 with Priority: HIGHEST for action security_group_rules [ 1171.257878] env[68328]: INFO networking_nsxv3.common.synchronization [req-32e398cf-fcf1-4181-b12a-45a67635e502 req-ac6e93f2-4388-45c3-9c55-9b884de282ec service nova] Enqueued Resource ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 with Priority: HIGHEST for action security_group_members [ 1171.258033] env[68328]: INFO networking_nsxv3.common.synchronization [req-32e398cf-fcf1-4181-b12a-45a67635e502 req-ac6e93f2-4388-45c3-9c55-9b884de282ec service nova] Enqueued Resource ID: df09884b-c9da-4108-b85b-46c0de736c1e with Priority: HIGHEST for action port [ 1171.258505] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 with Priority: HIGHEST for action security_group_rules [ 1171.258638] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 with Priority: HIGHEST for action security_group_members [ 1171.258731] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df09884b-c9da-4108-b85b-46c0de736c1e with Priority: HIGHEST for action port [ 1171.259013] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-261361c9-81c8-47fa-9a8a-4e37a8a439d7 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.259135] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.259214] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.259389] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.259467] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('261361c9-81c8-47fa-9a8a-4e37a8a439d7',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.260272] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-261361c9-81c8-47fa-9a8a-4e37a8a439d7 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.260366] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.260552] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-df09884b-c9da-4108-b85b-46c0de736c1e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.260648] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df09884b-c9da-4108-b85b-46c0de736c1e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.260709] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df09884b-c9da-4108-b85b-46c0de736c1e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.260860] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df09884b-c9da-4108-b85b-46c0de736c1e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.260958] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df09884b-c9da-4108-b85b-46c0de736c1e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.517326] env[68328]: INFO networking_nsxv3.common.synchronization [req-2fb5af1e-2dd7-4fa1-932d-6faf354c83e1 req-3a8bd23a-32a7-4d08-b9e4-d8a347eae49d tempest-InstanceActionsV221TestJSON-177614959 tempest-InstanceActionsV221TestJSON-177614959-project-member] Enqueued Resource ID: 4a187ea6-2982-413a-85b8-d76179583bdb with Priority: HIGHEST for action security_group_members [ 1171.517891] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a187ea6-2982-413a-85b8-d76179583bdb with Priority: HIGHEST for action security_group_members [ 1171.518198] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a187ea6-2982-413a-85b8-d76179583bdb taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.518329] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a187ea6-2982-413a-85b8-d76179583bdb" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.518395] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a187ea6-2982-413a-85b8-d76179583bdb" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.518656] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a187ea6-2982-413a-85b8-d76179583bdb" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.518821] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.518917] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.518972] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.519732] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.519732] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.519732] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a187ea6-2982-413a-85b8-d76179583bdb',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.577545] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.577785] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.577861] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.578079] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.578170] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.578363] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.578459] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.578520] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.578664] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.578740] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.578824] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 is going to be updated. [ 1171.584403] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8024e0cc-9eaa-4282-b00c-9e9b1de030e2: rpc.has_security_group_logging(os_id): False [ 1171.619314] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.619466] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.619538] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.619750] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.619860] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.620136] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.620234] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.620300] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.620463] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.620543] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.620647] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 is going to be updated. [ 1171.624710] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.624846] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.624902] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.625066] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.625203] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.645683] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 in Status: IN_PROGRESS for 2s [ 1171.747312] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.747452] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.747518] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.747733] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.747880] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.762949] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-261361c9-81c8-47fa-9a8a-4e37a8a439d7 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.762949] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.763100] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port df09884b-c9da-4108-b85b-46c0de736c1e with status ACTIVE [ 1171.763362] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.763519] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.763688] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.763888] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.763972] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.764157] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.764250] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.764307] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.764454] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.764575] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.764791] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.764880] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.764936] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.765086] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.765154] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.765233] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: df09884b-c9da-4108-b85b-46c0de736c1e is going to be updated. [ 1171.770305] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 in Status: IN_PROGRESS for 2s [ 1171.792546] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 in Status: SUCCESS [ 1171.794823] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 deletion is rescheduled due to dependency. [ 1171.794823] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.794823] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.795141] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.795430] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.795660] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.795801] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.796220] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.796673] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.797038] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('261361c9-81c8-47fa-9a8a-4e37a8a439d7',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.811345] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-216 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.811541] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-216" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.811672] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-216" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.811974] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-216" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.812275] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.812442] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.812563] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.812784] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.812933] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.813165] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1171.813284] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1171.813419] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1171.813508] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1171.813661] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1171.813792] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1171.813929] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1171.816029] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.816029] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.816029] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.816029] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.816245] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.816284] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df09884b-c9da-4108-b85b-46c0de736c1e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.857323] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1171.857475] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.044 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1171.857620] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1171.857804] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-216" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.858159] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-6e57c828-88e2-4d64-ae31-413a2aeb4692 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.858338] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-6e57c828-88e2-4d64-ae31-413a2aeb4692" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.858459] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-6e57c828-88e2-4d64-ae31-413a2aeb4692" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.858785] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-6e57c828-88e2-4d64-ae31-413a2aeb4692" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.858928] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e57c828-88e2-4d64-ae31-413a2aeb4692',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.021873] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.022062] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.022208] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.022453] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.022603] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.022841] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.022945] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.023017] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.023206] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.023283] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.023404] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a187ea6-2982-413a-85b8-d76179583bdb already deleted. [ 1172.023457] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a187ea6-2982-413a-85b8-d76179583bdb" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.299325] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('261361c9-81c8-47fa-9a8a-4e37a8a439d7',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.361705] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.362065] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.362496] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.362884] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.363219] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.364145] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 6e57c828-88e2-4d64-ae31-413a2aeb4692 not found, creating... [ 1172.364145] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.364307] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.365037] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.365037] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.365276] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.365794] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.366141] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.366414] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.366828] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.367132] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.367432] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 6e57c828-88e2-4d64-ae31-413a2aeb4692 is going to be created. [ 1172.387016] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.387262] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.387450] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.387779] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.388049] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.388332] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-6e57c828-88e2-4d64-ae31-413a2aeb4692" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.801836] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('261361c9-81c8-47fa-9a8a-4e37a8a439d7',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.049041] env[68328]: INFO networking_nsxv3.common.synchronization [req-e60d17c2-2584-48de-bab2-3d3924e4d527 req-9629c15d-3f36-447b-8979-aab26160222a tempest-ServersTestJSON-1771388484 tempest-ServersTestJSON-1771388484-project-member] Enqueued Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_members [ 1173.049041] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_members [ 1173.049041] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-5841566c-1d05-4389-b8a7-950b5f9c6708 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.049041] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.049041] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.049041] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.049041] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.049041] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.049041] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.049041] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.049041] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.049041] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.098908] env[68328]: INFO networking_nsxv3.common.synchronization [req-cd2bcdbc-6b55-4d47-881f-beb19893f212 req-a89e073e-cc21-45e2-8aec-88b801a71464 tempest-ServerRescueNegativeTestJSON-1315865897 tempest-ServerRescueNegativeTestJSON-1315865897-project-member] Enqueued Resource ID: 9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a with Priority: HIGHEST for action security_group_members [ 1173.099658] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a with Priority: HIGHEST for action security_group_members [ 1173.103599] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54390b69-5280-4540-a63f-fa4daae4a11f in Status: SUCCESS [ 1173.103800] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.104113] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.104232] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.104298] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.104502] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.104660] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.104755] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.104816] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.104959] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.105051] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.106870] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.106870] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.106870] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.106870] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.106870] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.106870] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.106870] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.106870] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.106870] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.106870] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('54390b69-5280-4540-a63f-fa4daae4a11f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.304121] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.310144] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.310144] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.310144] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.310144] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.310144] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 is going to be updated. [ 1173.338060] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.338060] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.338436] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.338436] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.338490] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.342431] env[68328]: INFO networking_nsxv3.common.synchronization [req-2fb5af1e-2dd7-4fa1-932d-6faf354c83e1 req-3703b7f4-0c8c-4c42-a957-efd971552a82 service nova] Enqueued Resource ID: 4a187ea6-2982-413a-85b8-d76179583bdb with Priority: HIGHEST for action security_group_rules [ 1173.342431] env[68328]: INFO networking_nsxv3.common.synchronization [req-2fb5af1e-2dd7-4fa1-932d-6faf354c83e1 req-3703b7f4-0c8c-4c42-a957-efd971552a82 service nova] Enqueued Resource ID: 4a187ea6-2982-413a-85b8-d76179583bdb with Priority: HIGHEST for action security_group_members [ 1173.342431] env[68328]: INFO networking_nsxv3.common.synchronization [req-2fb5af1e-2dd7-4fa1-932d-6faf354c83e1 req-3703b7f4-0c8c-4c42-a957-efd971552a82 service nova] Enqueued Resource ID: 6e57c828-88e2-4d64-ae31-413a2aeb4692 with Priority: HIGHEST for action port [ 1173.342431] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a187ea6-2982-413a-85b8-d76179583bdb with Priority: HIGHEST for action security_group_rules [ 1173.342734] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a187ea6-2982-413a-85b8-d76179583bdb with Priority: HIGHEST for action security_group_members [ 1173.342856] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e57c828-88e2-4d64-ae31-413a2aeb4692 with Priority: HIGHEST for action port [ 1173.343174] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a187ea6-2982-413a-85b8-d76179583bdb taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.343342] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a187ea6-2982-413a-85b8-d76179583bdb" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.343488] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a187ea6-2982-413a-85b8-d76179583bdb" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.343788] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a187ea6-2982-413a-85b8-d76179583bdb" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.343904] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a187ea6-2982-413a-85b8-d76179583bdb',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.347547] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a187ea6-2982-413a-85b8-d76179583bdb taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.347547] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a187ea6-2982-413a-85b8-d76179583bdb" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.347547] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a187ea6-2982-413a-85b8-d76179583bdb" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.347547] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a187ea6-2982-413a-85b8-d76179583bdb" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.347547] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.347547] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.347547] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.347547] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.347547] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.347547] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a187ea6-2982-413a-85b8-d76179583bdb',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.347547] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-6e57c828-88e2-4d64-ae31-413a2aeb4692 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.347547] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6e57c828-88e2-4d64-ae31-413a2aeb4692" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.347547] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6e57c828-88e2-4d64-ae31-413a2aeb4692" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.347547] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6e57c828-88e2-4d64-ae31-413a2aeb4692" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.347547] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e57c828-88e2-4d64-ae31-413a2aeb4692',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.348919] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 in Status: IN_PROGRESS for 2s [ 1173.551382] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.608740] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.609076] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.609325] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.609644] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.609817] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.610333] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.610532] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.610621] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.610868] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.610953] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.611092] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a is going to be updated. [ 1173.613335] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('54390b69-5280-4540-a63f-fa4daae4a11f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.643830] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.644571] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.644571] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.644571] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.644571] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.667765] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 in Status: SUCCESS [ 1173.667765] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 deletion is rescheduled due to dependency. [ 1173.667765] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.667765] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a in Status: IN_PROGRESS for 2s [ 1173.781731] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 in Status: SUCCESS [ 1173.782190] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.853483] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4a187ea6-2982-413a-85b8-d76179583bdb',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.854906] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a187ea6-2982-413a-85b8-d76179583bdb taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.854906] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a187ea6-2982-413a-85b8-d76179583bdb" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.854906] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6e57c828-88e2-4d64-ae31-413a2aeb4692 with status ACTIVE [ 1173.855092] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.855190] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.855240] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.855431] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.855517] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.855682] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.855774] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.855827] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.856517] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.856517] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.856517] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.856517] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.856517] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.856739] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.856739] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.856739] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6e57c828-88e2-4d64-ae31-413a2aeb4692 is going to be updated. [ 1173.876892] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.877054] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.877122] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.877321] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.877451] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.877606] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6e57c828-88e2-4d64-ae31-413a2aeb4692" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.054274] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.116540] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 54390b69-5280-4540-a63f-fa4daae4a11f: rpc.has_security_group_logging(os_id): False [ 1174.133235] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.133383] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.133506] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.134151] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.134151] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.134216] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.134302] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.134348] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.134558] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.134602] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.134705] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54390b69-5280-4540-a63f-fa4daae4a11f is going to be updated. [ 1174.217603] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.217845] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.217968] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.218294] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.218540] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.234445] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54390b69-5280-4540-a63f-fa4daae4a11f in Status: IN_PROGRESS for 2s [ 1174.360185] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4a187ea6-2982-413a-85b8-d76179583bdb',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.556767] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.556998] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.557157] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.557489] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.557640] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.557880] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 is going to be updated. [ 1174.585676] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.585676] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.585676] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.585676] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.585943] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.594555] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: IN_PROGRESS for 2s [ 1174.862589] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.862905] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.862905] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.863063] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.863153] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.863254] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a187ea6-2982-413a-85b8-d76179583bdb is going to be created. [ 1174.888198] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.888198] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.888198] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.888437] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.888568] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.897971] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a187ea6-2982-413a-85b8-d76179583bdb in Status: UNINITIALIZED for 2s [ 1175.358578] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 in Status: SUCCESS [ 1175.358853] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.359062] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.359275] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.359464] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.359580] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.359646] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.359849] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.359931] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.360026] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.360116] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('261361c9-81c8-47fa-9a8a-4e37a8a439d7',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.678792] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a in Status: SUCCESS [ 1175.678976] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a deletion is rescheduled due to dependency. [ 1175.679105] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.862878] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-261361c9-81c8-47fa-9a8a-4e37a8a439d7 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.863257] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.863257] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.863350] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.863537] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.863620] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.863665] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.863812] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.863892] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.863984] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.864133] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-261361c9-81c8-47fa-9a8a-4e37a8a439d7 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.864228] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.864277] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.864415] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.864551] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.864640] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.864711] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.864835] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.864907] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.864984] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.865081] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('261361c9-81c8-47fa-9a8a-4e37a8a439d7',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.246920] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54390b69-5280-4540-a63f-fa4daae4a11f in Status: SUCCESS [ 1176.247174] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.367598] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 261361c9-81c8-47fa-9a8a-4e37a8a439d7: rpc.has_security_group_logging(os_id): False [ 1176.388019] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.388019] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.388019] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.388019] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.388019] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.388019] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.388019] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.388019] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.388019] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.388019] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.388019] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.388019] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.388019] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.388019] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.388019] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.388614] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.388614] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.388614] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.388967] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.389152] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.389324] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 is going to be updated. [ 1176.456889] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.457159] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.457239] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.457463] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.457609] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.473410] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 in Status: IN_PROGRESS for 2s [ 1176.604918] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: SUCCESS [ 1176.604918] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.909928] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a187ea6-2982-413a-85b8-d76179583bdb in Status: SUCCESS [ 1176.910198] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a187ea6-2982-413a-85b8-d76179583bdb" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.910375] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a187ea6-2982-413a-85b8-d76179583bdb" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.910612] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a187ea6-2982-413a-85b8-d76179583bdb" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.910800] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.910911] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.910971] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.911171] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.911260] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.911348] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a187ea6-2982-413a-85b8-d76179583bdb" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.911437] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4a187ea6-2982-413a-85b8-d76179583bdb',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.414726] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a187ea6-2982-413a-85b8-d76179583bdb taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.414914] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a187ea6-2982-413a-85b8-d76179583bdb" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.414988] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a187ea6-2982-413a-85b8-d76179583bdb" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.415238] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a187ea6-2982-413a-85b8-d76179583bdb" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.415600] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.415600] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.415600] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.415774] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.415816] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.415989] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a187ea6-2982-413a-85b8-d76179583bdb" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.416218] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a187ea6-2982-413a-85b8-d76179583bdb taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.416316] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a187ea6-2982-413a-85b8-d76179583bdb" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.416377] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a187ea6-2982-413a-85b8-d76179583bdb" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.416536] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a187ea6-2982-413a-85b8-d76179583bdb" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.416793] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.417147] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.417147] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.417147] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.417254] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.417254] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a187ea6-2982-413a-85b8-d76179583bdb" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.417365] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4a187ea6-2982-413a-85b8-d76179583bdb',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.921249] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4a187ea6-2982-413a-85b8-d76179583bdb: rpc.has_security_group_logging(os_id): False [ 1177.937877] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.938170] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.938170] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.938319] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.938413] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.938649] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.938779] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.938840] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.938997] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.939096] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.939290] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.939387] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.939457] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.939594] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.939667] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.939844] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.939933] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.939986] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.940351] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.940435] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.940536] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a187ea6-2982-413a-85b8-d76179583bdb is going to be created. [ 1177.996155] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.996417] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.996504] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.996788] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.997067] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.006731] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a187ea6-2982-413a-85b8-d76179583bdb in Status: IN_PROGRESS for 2s [ 1178.343907] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1178.343907] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1178.489185] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 in Status: SUCCESS [ 1178.489506] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.842206] env[68328]: INFO networking_nsxv3.common.synchronization [req-3e903e9e-f50d-43f0-874a-38dbdc758687 req-9dc91200-fb8d-46d1-b731-7c0e97d012ed tempest-ServersTestJSON-1771388484 tempest-ServersTestJSON-1771388484-project-member] Enqueued Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_members [ 1179.842206] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_members [ 1179.842206] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-5841566c-1d05-4389-b8a7-950b5f9c6708 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.842622] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.842806] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.843150] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.843420] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.843668] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.845129] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.845129] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.845129] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.845129] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.018277] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a187ea6-2982-413a-85b8-d76179583bdb in Status: SUCCESS [ 1180.018546] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a187ea6-2982-413a-85b8-d76179583bdb" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.322382] env[68328]: INFO networking_nsxv3.common.synchronization [req-0b449cba-d6b9-4eb4-9fc0-daae7a3d5d2d req-e903c52a-5915-4e18-955e-570ae0e04678 tempest-AttachInterfacesTestJSON-966841523 tempest-AttachInterfacesTestJSON-966841523-project-member] Enqueued Resource ID: e27762cf-c0f5-443d-8332-584b8241d0be with Priority: HIGHEST for action security_group_members [ 1180.322955] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e27762cf-c0f5-443d-8332-584b8241d0be with Priority: HIGHEST for action security_group_members [ 1180.323367] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-e27762cf-c0f5-443d-8332-584b8241d0be taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.324028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e27762cf-c0f5-443d-8332-584b8241d0be" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.324028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e27762cf-c0f5-443d-8332-584b8241d0be" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.324028] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e27762cf-c0f5-443d-8332-584b8241d0be" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.324185] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.324238] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.324273] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.324422] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.324510] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.324603] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e27762cf-c0f5-443d-8332-584b8241d0be',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.346922] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.829660] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e27762cf-c0f5-443d-8332-584b8241d0be',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.849954] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.331862] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e27762cf-c0f5-443d-8332-584b8241d0be',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.354576] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.354576] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.354576] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.354576] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.354576] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.354576] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 is going to be updated. [ 1181.385020] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.385020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.385020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.385020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.385020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.392057] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: IN_PROGRESS for 2s [ 1181.521020] env[68328]: INFO networking_nsxv3.common.synchronization [req-e0e212ff-7cad-499b-97fe-e04588e5af73 req-09984eed-cea8-454e-8e63-b4fdf796f674 tempest-DeleteServersTestJSON-1696259291 tempest-DeleteServersTestJSON-1696259291-project-member] Enqueued Resource ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 with Priority: HIGHEST for action security_group_members [ 1181.521761] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 with Priority: HIGHEST for action security_group_members [ 1181.522089] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.522207] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.522273] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.522804] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.522964] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.523076] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.523141] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.523286] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.523371] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.523461] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c35aa45-69e7-4952-b5d8-8a7d6b3460e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.835443] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.835535] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.835583] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.836994] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.836994] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.836994] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e27762cf-c0f5-443d-8332-584b8241d0be is going to be updated. [ 1181.862113] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.862113] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.862113] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.862113] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.862113] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.868691] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-280 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.868931] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-280" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.869081] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-280" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.869466] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-280" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.869787] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.869957] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.870100] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.870323] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.870473] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.870705] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1181.870851] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1181.870990] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1181.871097] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1181.871214] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1181.871329] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1181.871472] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1181.873136] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e27762cf-c0f5-443d-8332-584b8241d0be in Status: IN_PROGRESS for 2s [ 1181.893582] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1181.893781] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1181.893927] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1181.894132] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-280" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.894458] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-a7107d06-e993-472d-80f9-dba048d7e563 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.894625] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-a7107d06-e993-472d-80f9-dba048d7e563" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.894788] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-a7107d06-e993-472d-80f9-dba048d7e563" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.895164] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-a7107d06-e993-472d-80f9-dba048d7e563" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.895313] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7107d06-e993-472d-80f9-dba048d7e563',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.025078] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.025251] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.025326] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.025542] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.025634] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.025830] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.025927] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.026032] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.026162] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.026225] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.026313] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 is going to be updated. [ 1182.050554] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.050752] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.050828] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.051026] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.051179] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.062134] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 in Status: IN_PROGRESS for 2s [ 1182.401025] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.401025] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.401025] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.401025] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.401025] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.401025] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port a7107d06-e993-472d-80f9-dba048d7e563 not found, creating... [ 1182.401025] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.401361] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.401361] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.401475] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.401749] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.402135] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.402378] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.402612] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.403010] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.403215] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.403467] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: a7107d06-e993-472d-80f9-dba048d7e563 is going to be created. [ 1182.423930] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.424207] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.424346] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.424686] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.424928] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.425217] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-a7107d06-e993-472d-80f9-dba048d7e563" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.197463] env[68328]: INFO networking_nsxv3.common.synchronization [req-69f48c08-504f-4a6e-8098-8a463620e27b req-3f559943-4150-45fd-b244-b1ac7871998c tempest-ServersNegativeTestJSON-1560044281 tempest-ServersNegativeTestJSON-1560044281-project-member] Enqueued Resource ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f with Priority: HIGHEST for action security_group_members [ 1183.197980] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f with Priority: HIGHEST for action security_group_members [ 1183.198292] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.198412] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.198478] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.198667] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.198813] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.198906] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.198968] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.199248] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.199342] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.199434] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0bcdd73-03e5-43ee-a623-9ac2490cee8f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.258648] env[68328]: INFO networking_nsxv3.common.synchronization [req-e0e212ff-7cad-499b-97fe-e04588e5af73 req-0f3ed763-a7aa-4689-ae91-dd2165973ae3 service nova] Enqueued Resource ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 with Priority: HIGHEST for action security_group_rules [ 1183.258835] env[68328]: INFO networking_nsxv3.common.synchronization [req-e0e212ff-7cad-499b-97fe-e04588e5af73 req-0f3ed763-a7aa-4689-ae91-dd2165973ae3 service nova] Enqueued Resource ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 with Priority: HIGHEST for action security_group_members [ 1183.258981] env[68328]: INFO networking_nsxv3.common.synchronization [req-e0e212ff-7cad-499b-97fe-e04588e5af73 req-0f3ed763-a7aa-4689-ae91-dd2165973ae3 service nova] Enqueued Resource ID: a7107d06-e993-472d-80f9-dba048d7e563 with Priority: HIGHEST for action port [ 1183.259230] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 with Priority: HIGHEST for action security_group_rules [ 1183.259363] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 with Priority: HIGHEST for action security_group_members [ 1183.259736] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7107d06-e993-472d-80f9-dba048d7e563 with Priority: HIGHEST for action port [ 1183.259943] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.260068] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.260133] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.260331] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.260409] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c35aa45-69e7-4952-b5d8-8a7d6b3460e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.261213] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.261307] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.261868] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7107d06-e993-472d-80f9-dba048d7e563 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.261868] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7107d06-e993-472d-80f9-dba048d7e563" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.261868] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7107d06-e993-472d-80f9-dba048d7e563" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.261868] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7107d06-e993-472d-80f9-dba048d7e563" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.261868] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7107d06-e993-472d-80f9-dba048d7e563',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.401747] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: SUCCESS [ 1183.401747] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.703166] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.703166] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.703166] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.703166] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.703166] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.703166] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.703166] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.703465] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.703496] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.703602] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.703764] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f is going to be updated. [ 1183.730958] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.731127] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.731178] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.731382] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.731527] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.739894] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f in Status: IN_PROGRESS for 2s [ 1183.763381] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.763487] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.765826] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a7107d06-e993-472d-80f9-dba048d7e563 with status ACTIVE [ 1183.766155] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.766296] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.766364] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.766609] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.766668] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.766843] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.766938] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.767008] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.767165] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.767242] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.767420] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.767511] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.767570] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.767708] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.767783] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.767866] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a7107d06-e993-472d-80f9-dba048d7e563 is going to be updated. [ 1183.790399] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.790587] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.790627] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.790805] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.790932] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.791099] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7107d06-e993-472d-80f9-dba048d7e563" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.884718] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e27762cf-c0f5-443d-8332-584b8241d0be in Status: SUCCESS [ 1183.885445] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e27762cf-c0f5-443d-8332-584b8241d0be" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.072896] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 in Status: SUCCESS [ 1184.073097] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 deletion is rescheduled due to dependency. [ 1184.073212] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.073372] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.073583] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.073817] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.073930] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.073991] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.074159] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.074239] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.074330] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c35aa45-69e7-4952-b5d8-8a7d6b3460e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.576272] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7c35aa45-69e7-4952-b5d8-8a7d6b3460e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.050048] env[68328]: INFO networking_nsxv3.common.synchronization [req-63b5c2ab-2e43-46e5-9c9f-71d99229e7eb req-ddda948c-f292-4d76-b7e7-f7c087750b54 tempest-InstanceActionsV221TestJSON-177614959 tempest-InstanceActionsV221TestJSON-177614959-project-member] Enqueued Resource ID: 4a187ea6-2982-413a-85b8-d76179583bdb with Priority: HIGHEST for action security_group_members [ 1185.050048] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a187ea6-2982-413a-85b8-d76179583bdb with Priority: HIGHEST for action security_group_members [ 1185.050243] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a187ea6-2982-413a-85b8-d76179583bdb taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.050243] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a187ea6-2982-413a-85b8-d76179583bdb" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.050387] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a187ea6-2982-413a-85b8-d76179583bdb" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.050539] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a187ea6-2982-413a-85b8-d76179583bdb" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.050720] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.050855] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.050947] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.051038] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.051215] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.051215] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a187ea6-2982-413a-85b8-d76179583bdb',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.078867] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7c35aa45-69e7-4952-b5d8-8a7d6b3460e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.304734] env[68328]: INFO networking_nsxv3.common.synchronization [req-cb147448-1eb0-4552-a0df-1d136d7472ea req-8c6b4dfb-4a10-4f05-9fb8-da86161651e2 tempest-ServerRescueNegativeTestJSON-1315865897 tempest-ServerRescueNegativeTestJSON-1315865897-project-member] Enqueued Resource ID: fef607f8-3758-4e8a-87f1-a5984690df6e with Priority: HIGHEST for action security_group_members [ 1185.305323] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fef607f8-3758-4e8a-87f1-a5984690df6e with Priority: HIGHEST for action security_group_members [ 1185.305637] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-fef607f8-3758-4e8a-87f1-a5984690df6e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.305755] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.305816] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.306044] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.306200] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.306301] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.306358] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.306514] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.306601] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.306692] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fef607f8-3758-4e8a-87f1-a5984690df6e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.553453] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.553608] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.553737] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.553965] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.554078] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.554297] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.554400] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.554463] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.554616] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.554702] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.554797] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a187ea6-2982-413a-85b8-d76179583bdb is going to be updated. [ 1185.579319] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.579580] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.579580] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.579649] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.579752] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.581218] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.581327] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.581455] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.581580] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.581658] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.581767] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 is going to be updated. [ 1185.589318] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a187ea6-2982-413a-85b8-d76179583bdb in Status: IN_PROGRESS for 2s [ 1185.607652] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.607833] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.607878] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.608214] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.608351] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.616812] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 in Status: IN_PROGRESS for 2s [ 1185.748982] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f in Status: SUCCESS [ 1185.749406] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f deletion is rescheduled due to dependency. [ 1185.749406] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.808931] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fef607f8-3758-4e8a-87f1-a5984690df6e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.313067] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fef607f8-3758-4e8a-87f1-a5984690df6e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.815554] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.815953] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.815953] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.816048] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.816083] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.816199] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fef607f8-3758-4e8a-87f1-a5984690df6e is going to be updated. [ 1186.844042] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.844217] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.844319] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.844555] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.844733] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.852806] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fef607f8-3758-4e8a-87f1-a5984690df6e in Status: IN_PROGRESS for 2s [ 1187.598997] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a187ea6-2982-413a-85b8-d76179583bdb in Status: SUCCESS [ 1187.599198] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a187ea6-2982-413a-85b8-d76179583bdb deletion is rescheduled due to dependency. [ 1187.599297] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a187ea6-2982-413a-85b8-d76179583bdb" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.624462] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 in Status: SUCCESS [ 1187.624666] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.624851] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.625088] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.625307] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.625426] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.625491] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.625648] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.625729] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.625817] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.625905] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7c35aa45-69e7-4952-b5d8-8a7d6b3460e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.974823] env[68328]: INFO networking_nsxv3.common.synchronization [req-38d8dd65-b941-494c-b129-859af514e304 req-43fcb9be-d755-47d0-af88-b812e17bb93f tempest-AttachInterfacesTestJSON-966841523 tempest-AttachInterfacesTestJSON-966841523-project-member] Enqueued Resource ID: e27762cf-c0f5-443d-8332-584b8241d0be with Priority: HIGHEST for action security_group_members [ 1187.975418] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e27762cf-c0f5-443d-8332-584b8241d0be with Priority: HIGHEST for action security_group_members [ 1187.975844] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-e27762cf-c0f5-443d-8332-584b8241d0be taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.977671] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e27762cf-c0f5-443d-8332-584b8241d0be" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.977671] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e27762cf-c0f5-443d-8332-584b8241d0be" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.977671] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e27762cf-c0f5-443d-8332-584b8241d0be" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.977671] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.977671] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.977671] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.977671] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.977671] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.977671] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e27762cf-c0f5-443d-8332-584b8241d0be',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.128133] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.128390] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.128390] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.128630] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.128844] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.128971] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.129057] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.129267] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.129381] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.129497] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.129675] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.129798] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.129879] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.130106] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.130284] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.130379] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.130476] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.130647] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.130750] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.130858] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.130964] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7c35aa45-69e7-4952-b5d8-8a7d6b3460e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.484050] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.484227] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.484348] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.484589] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.484734] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.484967] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.485075] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.485147] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.485343] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.485424] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.485525] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e27762cf-c0f5-443d-8332-584b8241d0be is going to be updated. [ 1188.509889] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.510170] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.510170] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.510302] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.510436] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.518505] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e27762cf-c0f5-443d-8332-584b8241d0be in Status: IN_PROGRESS for 2s [ 1188.633638] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1: rpc.has_security_group_logging(os_id): False [ 1188.650270] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.650482] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.650564] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.650822] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.650946] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.651250] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.651388] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.651497] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.651705] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.651876] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.652119] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.652271] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.652379] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.652573] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.652694] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.653048] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.653209] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.653320] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.653513] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.653626] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.653779] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 is going to be updated. [ 1188.735793] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.735967] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.736030] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.736242] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.736382] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.754553] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 in Status: IN_PROGRESS for 2s [ 1188.862771] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fef607f8-3758-4e8a-87f1-a5984690df6e in Status: SUCCESS [ 1188.862978] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.529043] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e27762cf-c0f5-443d-8332-584b8241d0be in Status: SUCCESS [ 1190.529043] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e27762cf-c0f5-443d-8332-584b8241d0be deletion is rescheduled due to dependency. [ 1190.529043] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e27762cf-c0f5-443d-8332-584b8241d0be" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.778349] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 in Status: SUCCESS [ 1190.778349] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.633020] env[68328]: INFO networking_nsxv3.common.synchronization [req-07418b27-1b3e-4a4e-aa21-f775fb100260 req-d01693cc-777c-49db-a66c-4ccc96ab0518 tempest-ServersTestJSON-1771388484 tempest-ServersTestJSON-1771388484-project-member] Enqueued Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_members [ 1192.633753] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_members [ 1192.634616] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-5841566c-1d05-4389-b8a7-950b5f9c6708 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.634861] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.634968] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.636113] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.636113] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.638845] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.638845] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.638960] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.639209] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.639253] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.905512] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-384 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.905919] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-384" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.905919] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-384" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.906113] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-384" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.906475] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.906577] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.906699] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.907281] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.907281] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.907281] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1192.907429] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1192.907468] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1192.907579] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1192.907686] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1192.907791] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1192.908292] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1192.927626] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1192.928124] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1192.928124] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1192.928269] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-384" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.928617] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-844a0468-4c8e-48c2-ab61-ce7ae742079c taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.928739] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-844a0468-4c8e-48c2-ab61-ce7ae742079c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.928780] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-844a0468-4c8e-48c2-ab61-ce7ae742079c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.929118] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-844a0468-4c8e-48c2-ab61-ce7ae742079c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.929279] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('844a0468-4c8e-48c2-ab61-ce7ae742079c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.141906] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.432141] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.432340] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.432464] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.432763] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.432936] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.433113] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 844a0468-4c8e-48c2-ab61-ce7ae742079c not found, creating... [ 1193.433441] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.433544] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.433666] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.433944] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.434108] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.434400] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.434565] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.434688] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.434930] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.435095] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.435244] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 844a0468-4c8e-48c2-ab61-ce7ae742079c is going to be created. [ 1193.454330] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.454511] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.454642] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.454879] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.455126] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.455343] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-844a0468-4c8e-48c2-ab61-ce7ae742079c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.645199] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.148102] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.148275] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.148344] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.148611] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.148668] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.148750] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 is going to be updated. [ 1194.151693] env[68328]: INFO networking_nsxv3.common.synchronization [req-07418b27-1b3e-4a4e-aa21-f775fb100260 req-b9123166-e77f-4219-8606-9119f97c0898 service nova] Enqueued Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_rules [ 1194.151888] env[68328]: INFO networking_nsxv3.common.synchronization [req-07418b27-1b3e-4a4e-aa21-f775fb100260 req-b9123166-e77f-4219-8606-9119f97c0898 service nova] Enqueued Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_members [ 1194.152119] env[68328]: INFO networking_nsxv3.common.synchronization [req-07418b27-1b3e-4a4e-aa21-f775fb100260 req-b9123166-e77f-4219-8606-9119f97c0898 service nova] Enqueued Resource ID: 844a0468-4c8e-48c2-ab61-ce7ae742079c with Priority: HIGHEST for action port [ 1194.152903] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_rules [ 1194.153051] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_members [ 1194.153150] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 844a0468-4c8e-48c2-ab61-ce7ae742079c with Priority: HIGHEST for action port [ 1194.153414] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5841566c-1d05-4389-b8a7-950b5f9c6708 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.153526] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.153589] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.153770] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.153871] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.154674] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-5841566c-1d05-4389-b8a7-950b5f9c6708 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.154768] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.154977] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-844a0468-4c8e-48c2-ab61-ce7ae742079c taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.155090] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-844a0468-4c8e-48c2-ab61-ce7ae742079c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.155154] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-844a0468-4c8e-48c2-ab61-ce7ae742079c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.155313] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-844a0468-4c8e-48c2-ab61-ce7ae742079c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.155385] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('844a0468-4c8e-48c2-ab61-ce7ae742079c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.177825] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.177961] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.178010] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.179162] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.179162] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.186973] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: IN_PROGRESS for 2s [ 1194.657764] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-5841566c-1d05-4389-b8a7-950b5f9c6708 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.657764] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.661500] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 844a0468-4c8e-48c2-ab61-ce7ae742079c with status ACTIVE [ 1194.661500] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.661500] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.661500] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.661500] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.661500] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.661500] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.661500] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.661500] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.661500] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.661500] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.661500] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.661500] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.661500] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.661500] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.661500] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.661500] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 844a0468-4c8e-48c2-ab61-ce7ae742079c is going to be updated. [ 1194.681491] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.681691] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.681762] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.681983] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.682339] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.682393] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-844a0468-4c8e-48c2-ab61-ce7ae742079c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.202018] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: SUCCESS [ 1196.202018] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.202018] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.202018] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.202018] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.202766] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.202867] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.203131] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.203190] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.203325] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.707817] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.210010] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.711933] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.712132] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.712190] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.712397] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.712485] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.712585] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 is going to be updated. [ 1197.740030] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.740030] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.740030] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.740030] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.740310] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.750808] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: IN_PROGRESS for 2s [ 1197.769449] env[68328]: INFO networking_nsxv3.common.synchronization [None req-3f794c0f-c857-4f9e-be3e-1528dec72eed tempest-AttachInterfacesTestJSON-966841523 tempest-AttachInterfacesTestJSON-966841523-project-member] Enqueued Resource ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 with Priority: HIGHEST for action security_group_members [ 1197.769943] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 with Priority: HIGHEST for action security_group_members [ 1197.770257] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.770966] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.770966] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.770966] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.770966] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.771129] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.771129] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.771616] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.771616] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.771616] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('398e93bc-b7ea-4684-aa02-2e6ab22c1fe5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.274878] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.275181] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.275181] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.275406] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.275469] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.275687] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.275790] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.275852] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.276033] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.276124] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.276220] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 is going to be updated. [ 1198.307758] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.307758] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.307758] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.307758] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.307758] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.315876] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 in Status: IN_PROGRESS for 2s [ 1198.787152] env[68328]: INFO networking_nsxv3.common.synchronization [req-cc2c4ef4-0dcc-42ec-8936-d07cd168faa0 req-7e5732af-e629-46da-bd61-7a86b222785e tempest-ServerRescueNegativeTestJSON-1315865897 tempest-ServerRescueNegativeTestJSON-1315865897-project-member] Enqueued Resource ID: fef607f8-3758-4e8a-87f1-a5984690df6e with Priority: HIGHEST for action security_group_members [ 1198.787609] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fef607f8-3758-4e8a-87f1-a5984690df6e with Priority: HIGHEST for action security_group_members [ 1198.787909] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-fef607f8-3758-4e8a-87f1-a5984690df6e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.788033] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.788098] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.788290] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.788438] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.788532] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.788591] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.788732] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.788838] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.788982] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fef607f8-3758-4e8a-87f1-a5984690df6e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.291823] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.292154] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.292154] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.292295] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.292360] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.293095] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.293095] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.293095] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.293095] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.293095] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.293095] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fef607f8-3758-4e8a-87f1-a5984690df6e is going to be updated. [ 1199.339806] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.340010] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.340109] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.340362] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.340517] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.350276] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fef607f8-3758-4e8a-87f1-a5984690df6e in Status: IN_PROGRESS for 2s [ 1199.761008] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: SUCCESS [ 1199.761255] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.761421] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.761650] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.761837] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.761948] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.762014] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.762171] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.762250] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.762332] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.762426] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.264997] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-5841566c-1d05-4389-b8a7-950b5f9c6708 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.265180] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.265248] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.265462] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.265626] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.265725] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.265788] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.265936] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.266049] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.266189] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.266390] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-5841566c-1d05-4389-b8a7-950b5f9c6708 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.266489] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.266552] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.266696] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.266833] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.266923] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.266985] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.267161] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.267240] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.267320] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.267407] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.326512] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 in Status: SUCCESS [ 1200.326768] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 deletion is rescheduled due to dependency. [ 1200.326838] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.769506] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5841566c-1d05-4389-b8a7-950b5f9c6708: rpc.has_security_group_logging(os_id): False [ 1200.786585] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.786750] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.786822] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.787191] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.787191] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.787391] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.787490] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.787552] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.787706] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.787781] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.787969] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.788104] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.788271] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.788329] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.788399] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.788578] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.788670] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.788730] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.788870] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.788947] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.789691] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 is going to be updated. [ 1200.853714] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.853714] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.853714] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.853714] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.853714] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.870693] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: IN_PROGRESS for 2s [ 1201.360980] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fef607f8-3758-4e8a-87f1-a5984690df6e in Status: SUCCESS [ 1201.361304] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fef607f8-3758-4e8a-87f1-a5984690df6e deletion is rescheduled due to dependency. [ 1201.361304] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.076459] env[68328]: INFO networking_nsxv3.common.synchronization [None req-71a3af14-ba9e-4b10-b3df-06c863a6ada1 None None] Enqueued Resource ID: 71e4e9c7-f901-4dca-9298-8966af0a33dd with Priority: HIGHEST for action port [ 1202.076719] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71e4e9c7-f901-4dca-9298-8966af0a33dd with Priority: HIGHEST for action port [ 1202.077288] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-71e4e9c7-f901-4dca-9298-8966af0a33dd taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.077413] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71e4e9c7-f901-4dca-9298-8966af0a33dd" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.077481] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71e4e9c7-f901-4dca-9298-8966af0a33dd" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.077723] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71e4e9c7-f901-4dca-9298-8966af0a33dd" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.077806] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71e4e9c7-f901-4dca-9298-8966af0a33dd',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.590940] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 71e4e9c7-f901-4dca-9298-8966af0a33dd [ 1202.591193] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.591907] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.591907] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.591907] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.591907] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.591907] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:71e4e9c7-f901-4dca-9298-8966af0a33dd already deleted. [ 1202.591907] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71e4e9c7-f901-4dca-9298-8966af0a33dd" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.886706] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: SUCCESS [ 1202.886822] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.243607] env[68328]: INFO networking_nsxv3.common.synchronization [None req-00c52aec-aead-4335-a64f-2872be00cadc None None] Enqueued Resource ID: 7aeac00a-0efb-43c3-8088-675a8c4151c1 with Priority: HIGHEST for action port [ 1204.244227] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7aeac00a-0efb-43c3-8088-675a8c4151c1 with Priority: HIGHEST for action port [ 1204.244595] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-7aeac00a-0efb-43c3-8088-675a8c4151c1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.244736] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7aeac00a-0efb-43c3-8088-675a8c4151c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.244801] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7aeac00a-0efb-43c3-8088-675a8c4151c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.245103] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7aeac00a-0efb-43c3-8088-675a8c4151c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.245215] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7aeac00a-0efb-43c3-8088-675a8c4151c1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.748348] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7aeac00a-0efb-43c3-8088-675a8c4151c1 [ 1204.751163] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.751163] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.751163] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.751163] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.751163] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.751163] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7aeac00a-0efb-43c3-8088-675a8c4151c1 already deleted. [ 1204.751163] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7aeac00a-0efb-43c3-8088-675a8c4151c1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.948204] env[68328]: INFO networking_nsxv3.common.synchronization [req-94a1b53c-9309-43d5-aa72-d73bfe766964 req-f47ca041-0127-4afc-9ba6-b78296334399 tempest-AttachVolumeShelveTestJSON-1223620556 tempest-AttachVolumeShelveTestJSON-1223620556-project-member] Enqueued Resource ID: 551b86cb-6c17-4238-9ac7-89fd77e1e91b with Priority: HIGHEST for action security_group_members [ 1205.951499] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 551b86cb-6c17-4238-9ac7-89fd77e1e91b with Priority: HIGHEST for action security_group_members [ 1205.951499] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-551b86cb-6c17-4238-9ac7-89fd77e1e91b taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.951499] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-551b86cb-6c17-4238-9ac7-89fd77e1e91b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.951499] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-551b86cb-6c17-4238-9ac7-89fd77e1e91b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.951499] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-551b86cb-6c17-4238-9ac7-89fd77e1e91b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.951499] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.951499] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.951499] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.951499] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.951499] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.951499] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('551b86cb-6c17-4238-9ac7-89fd77e1e91b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.454373] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.454519] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.454588] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.454803] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.454888] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.455102] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.455194] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.455252] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.455402] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.455475] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.455557] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 551b86cb-6c17-4238-9ac7-89fd77e1e91b is going to be updated. [ 1206.468473] env[68328]: INFO networking_nsxv3.common.synchronization [req-3ee9074b-a5df-4a0d-8ce0-8a4ee1ab798a req-6ab911e4-b10f-4658-b12a-33e2b73b4d77 tempest-ServersTestJSON-1771388484 tempest-ServersTestJSON-1771388484-project-member] Enqueued Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_members [ 1206.468896] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_members [ 1206.469200] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-5841566c-1d05-4389-b8a7-950b5f9c6708 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.469317] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.469382] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.469553] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.469700] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.469793] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.469846] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.469989] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.470083] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.470963] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.487160] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.487298] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.487613] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.487613] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.487727] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.497288] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 551b86cb-6c17-4238-9ac7-89fd77e1e91b in Status: IN_PROGRESS for 2s [ 1206.972558] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.474974] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.626157] env[68328]: INFO networking_nsxv3.common.synchronization [req-6b48fcc2-070d-4ae5-8422-7485bd5e0b26 req-b2d91394-2fbb-4bcc-9d40-79a3e905251f tempest-InstanceActionsTestJSON-1807673419 tempest-InstanceActionsTestJSON-1807673419-project-member] Enqueued Resource ID: 59e1c3b9-919d-40eb-abaa-23f4746bb660 with Priority: HIGHEST for action security_group_members [ 1207.626157] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59e1c3b9-919d-40eb-abaa-23f4746bb660 with Priority: HIGHEST for action security_group_members [ 1207.626157] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-59e1c3b9-919d-40eb-abaa-23f4746bb660 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.626157] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59e1c3b9-919d-40eb-abaa-23f4746bb660" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.626157] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59e1c3b9-919d-40eb-abaa-23f4746bb660" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.626157] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59e1c3b9-919d-40eb-abaa-23f4746bb660" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.626670] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.626949] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.627161] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.627445] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.627675] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.627913] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59e1c3b9-919d-40eb-abaa-23f4746bb660',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.946811] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-912 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.947070] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-912" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.947226] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-912" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.947610] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-912" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.947822] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.947989] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.948127] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.948347] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.948494] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.948711] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1207.948829] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1207.948943] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1207.949237] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1207.949387] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1207.949909] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1207.949909] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1207.971417] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1207.971676] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1207.971983] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1207.972254] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-912" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.972575] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-be2b58c4-d4cb-42e1-b237-e7fe3313a287 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.972849] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-be2b58c4-d4cb-42e1-b237-e7fe3313a287" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.972911] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-be2b58c4-d4cb-42e1-b237-e7fe3313a287" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.973292] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-be2b58c4-d4cb-42e1-b237-e7fe3313a287" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.973463] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be2b58c4-d4cb-42e1-b237-e7fe3313a287',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.977885] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.978013] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.978056] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.978263] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.978363] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.978458] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 is going to be updated. [ 1208.007381] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.007564] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.007624] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.007779] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.007916] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.017907] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: IN_PROGRESS for 2s [ 1208.130035] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.130205] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.130263] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.130592] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.130752] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.130996] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.131120] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.131278] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.131355] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.131469] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.131572] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59e1c3b9-919d-40eb-abaa-23f4746bb660 already deleted. [ 1208.131653] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59e1c3b9-919d-40eb-abaa-23f4746bb660" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.477124] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.477394] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.477537] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.477853] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.478051] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.478232] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port be2b58c4-d4cb-42e1-b237-e7fe3313a287 not found, creating... [ 1208.478537] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.478701] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.478853] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.479104] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.479289] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.479602] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.479781] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.479906] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.480160] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.480307] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.480494] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: be2b58c4-d4cb-42e1-b237-e7fe3313a287 is going to be created. [ 1208.500326] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.500595] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.500737] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.501047] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.501322] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.501589] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-be2b58c4-d4cb-42e1-b237-e7fe3313a287" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.509455] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 551b86cb-6c17-4238-9ac7-89fd77e1e91b in Status: SUCCESS [ 1208.509638] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 551b86cb-6c17-4238-9ac7-89fd77e1e91b deletion is rescheduled due to dependency. [ 1208.509763] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-551b86cb-6c17-4238-9ac7-89fd77e1e91b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.165614] env[68328]: INFO networking_nsxv3.common.synchronization [req-6b48fcc2-070d-4ae5-8422-7485bd5e0b26 req-3c6e9d4e-393e-422c-9973-31278556b3d1 service nova] Enqueued Resource ID: 59e1c3b9-919d-40eb-abaa-23f4746bb660 with Priority: HIGHEST for action security_group_rules [ 1209.165893] env[68328]: INFO networking_nsxv3.common.synchronization [req-6b48fcc2-070d-4ae5-8422-7485bd5e0b26 req-3c6e9d4e-393e-422c-9973-31278556b3d1 service nova] Enqueued Resource ID: 59e1c3b9-919d-40eb-abaa-23f4746bb660 with Priority: HIGHEST for action security_group_members [ 1209.165975] env[68328]: INFO networking_nsxv3.common.synchronization [req-6b48fcc2-070d-4ae5-8422-7485bd5e0b26 req-3c6e9d4e-393e-422c-9973-31278556b3d1 service nova] Enqueued Resource ID: be2b58c4-d4cb-42e1-b237-e7fe3313a287 with Priority: HIGHEST for action port [ 1209.167093] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59e1c3b9-919d-40eb-abaa-23f4746bb660 with Priority: HIGHEST for action security_group_rules [ 1209.167093] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59e1c3b9-919d-40eb-abaa-23f4746bb660 with Priority: HIGHEST for action security_group_members [ 1209.167093] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be2b58c4-d4cb-42e1-b237-e7fe3313a287 with Priority: HIGHEST for action port [ 1209.167093] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-59e1c3b9-919d-40eb-abaa-23f4746bb660 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.168158] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-59e1c3b9-919d-40eb-abaa-23f4746bb660" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.168871] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-59e1c3b9-919d-40eb-abaa-23f4746bb660" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.168871] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-59e1c3b9-919d-40eb-abaa-23f4746bb660" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.168871] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('59e1c3b9-919d-40eb-abaa-23f4746bb660',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.169639] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-59e1c3b9-919d-40eb-abaa-23f4746bb660 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.169746] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59e1c3b9-919d-40eb-abaa-23f4746bb660" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.169809] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59e1c3b9-919d-40eb-abaa-23f4746bb660" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.169981] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59e1c3b9-919d-40eb-abaa-23f4746bb660" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.170210] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.170313] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.170368] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.170512] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.170597] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.170687] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59e1c3b9-919d-40eb-abaa-23f4746bb660',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.171556] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-be2b58c4-d4cb-42e1-b237-e7fe3313a287 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.171667] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be2b58c4-d4cb-42e1-b237-e7fe3313a287" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.171720] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be2b58c4-d4cb-42e1-b237-e7fe3313a287" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.171876] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be2b58c4-d4cb-42e1-b237-e7fe3313a287" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.171966] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be2b58c4-d4cb-42e1-b237-e7fe3313a287',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.673499] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('59e1c3b9-919d-40eb-abaa-23f4746bb660',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.674744] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-59e1c3b9-919d-40eb-abaa-23f4746bb660 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.674870] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59e1c3b9-919d-40eb-abaa-23f4746bb660" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.675314] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port be2b58c4-d4cb-42e1-b237-e7fe3313a287 with status ACTIVE [ 1209.675509] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.675651] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.675746] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.676210] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.676359] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.676541] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.676663] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.676745] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.676943] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.677071] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.677248] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.677345] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.677405] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.677545] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.677618] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.677699] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: be2b58c4-d4cb-42e1-b237-e7fe3313a287 is going to be updated. [ 1209.707669] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.707814] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.707897] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.708083] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.708254] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.708770] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be2b58c4-d4cb-42e1-b237-e7fe3313a287" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.027047] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: SUCCESS [ 1210.027265] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.176479] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('59e1c3b9-919d-40eb-abaa-23f4746bb660',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.680029] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.680378] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.680378] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.680476] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.680506] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.680625] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59e1c3b9-919d-40eb-abaa-23f4746bb660 is going to be created. [ 1210.704234] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.704421] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.704497] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.704682] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.704849] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.713198] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59e1c3b9-919d-40eb-abaa-23f4746bb660 in Status: UNINITIALIZED for 2s [ 1211.728953] env[68328]: INFO networking_nsxv3.common.synchronization [None req-da263abe-7ccd-44e5-ad3d-4dd8964f33a0 tempest-AttachVolumeShelveTestJSON-1223620556 tempest-AttachVolumeShelveTestJSON-1223620556-project-member] Enqueued Resource ID: b1c2fa85-ca03-4043-a12f-6ed71cf5c151 with Priority: HIGHEST for action security_group_rules [ 1211.729686] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1c2fa85-ca03-4043-a12f-6ed71cf5c151 with Priority: HIGHEST for action security_group_rules [ 1211.729998] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1c2fa85-ca03-4043-a12f-6ed71cf5c151 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.730133] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1c2fa85-ca03-4043-a12f-6ed71cf5c151" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.730199] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1c2fa85-ca03-4043-a12f-6ed71cf5c151" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.730445] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1c2fa85-ca03-4043-a12f-6ed71cf5c151" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.730527] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1c2fa85-ca03-4043-a12f-6ed71cf5c151',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.879368] env[68328]: INFO networking_nsxv3.common.synchronization [None req-c6e5d663-884c-4141-84be-476d25e68ff2 tempest-AttachVolumeShelveTestJSON-1223620556 tempest-AttachVolumeShelveTestJSON-1223620556-project-member] Enqueued Resource ID: b1c2fa85-ca03-4043-a12f-6ed71cf5c151 with Priority: HIGHEST for action security_group_rules [ 1211.879883] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1c2fa85-ca03-4043-a12f-6ed71cf5c151 with Priority: HIGHEST for action security_group_rules [ 1211.880302] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1c2fa85-ca03-4043-a12f-6ed71cf5c151 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.880397] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1c2fa85-ca03-4043-a12f-6ed71cf5c151" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.037273] env[68328]: INFO networking_nsxv3.common.synchronization [req-0a5c7e3b-2bc8-4b76-89c0-b2b106aa7624 req-38e2e769-3630-4936-9486-931422a92ec3 tempest-AttachVolumeTestJSON-972540760 tempest-AttachVolumeTestJSON-972540760-project-member] Enqueued Resource ID: b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724 with Priority: HIGHEST for action security_group_members [ 1212.037775] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724 with Priority: HIGHEST for action security_group_members [ 1212.040145] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.040299] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.040393] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.040602] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.040811] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.040918] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.040974] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.041145] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.041228] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.041563] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.250043] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.250222] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.250269] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.250451] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.250546] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.250645] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1c2fa85-ca03-4043-a12f-6ed71cf5c151 already deleted. [ 1212.250843] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1c2fa85-ca03-4043-a12f-6ed71cf5c151" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.250843] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1c2fa85-ca03-4043-a12f-6ed71cf5c151" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.251012] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1c2fa85-ca03-4043-a12f-6ed71cf5c151" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.251100] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1c2fa85-ca03-4043-a12f-6ed71cf5c151',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.544125] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.544337] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.544386] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.544576] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.544667] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.544867] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.544970] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.545036] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.545217] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.545298] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.545388] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724 is going to be updated. [ 1212.578238] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.578238] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.578238] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.578238] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.578238] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.585846] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724 in Status: IN_PROGRESS for 2s [ 1212.605111] env[68328]: INFO networking_nsxv3.common.synchronization [req-d9432333-8f5e-4845-98ca-0a5cd0894f15 req-d330f4db-3bbf-4d92-98e0-2784707c0993 tempest-ServerDiskConfigTestJSON-155339900 tempest-ServerDiskConfigTestJSON-155339900-project-member] Enqueued Resource ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 with Priority: HIGHEST for action security_group_members [ 1212.605111] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 with Priority: HIGHEST for action security_group_members [ 1212.605111] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-261361c9-81c8-47fa-9a8a-4e37a8a439d7 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.605111] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.605111] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.605907] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.605907] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.605907] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.605907] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.606484] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.606666] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.606848] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('261361c9-81c8-47fa-9a8a-4e37a8a439d7',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.725233] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59e1c3b9-919d-40eb-abaa-23f4746bb660 in Status: SUCCESS [ 1212.725233] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59e1c3b9-919d-40eb-abaa-23f4746bb660" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.725233] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59e1c3b9-919d-40eb-abaa-23f4746bb660" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.725233] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59e1c3b9-919d-40eb-abaa-23f4746bb660" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.725233] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.725233] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.725233] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.725233] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.725233] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.725233] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59e1c3b9-919d-40eb-abaa-23f4746bb660" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.725233] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('59e1c3b9-919d-40eb-abaa-23f4746bb660',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.769884] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.769884] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.769884] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.769884] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.769884] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.769884] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1c2fa85-ca03-4043-a12f-6ed71cf5c151 already deleted. [ 1212.769884] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1c2fa85-ca03-4043-a12f-6ed71cf5c151" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.109667] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.109846] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.109884] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.110143] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.110241] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.110442] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.110548] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.110598] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.110745] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.110821] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.110897] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 is going to be updated. [ 1213.142447] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.142758] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.142758] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.142990] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.143174] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.154065] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 in Status: IN_PROGRESS for 2s [ 1213.229110] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-59e1c3b9-919d-40eb-abaa-23f4746bb660 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.229344] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59e1c3b9-919d-40eb-abaa-23f4746bb660" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.229344] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59e1c3b9-919d-40eb-abaa-23f4746bb660" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.229503] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59e1c3b9-919d-40eb-abaa-23f4746bb660" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.229637] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.229733] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.229793] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.229965] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.230034] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.230109] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59e1c3b9-919d-40eb-abaa-23f4746bb660" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.230256] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-59e1c3b9-919d-40eb-abaa-23f4746bb660 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.230344] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59e1c3b9-919d-40eb-abaa-23f4746bb660" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.230413] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59e1c3b9-919d-40eb-abaa-23f4746bb660" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.230534] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59e1c3b9-919d-40eb-abaa-23f4746bb660" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.230666] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.230749] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.230822] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.230937] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.231017] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.231101] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59e1c3b9-919d-40eb-abaa-23f4746bb660" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.231212] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('59e1c3b9-919d-40eb-abaa-23f4746bb660',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.733611] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 59e1c3b9-919d-40eb-abaa-23f4746bb660: rpc.has_security_group_logging(os_id): False [ 1213.761607] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.761751] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.761827] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.762095] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.762179] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.762387] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.762487] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.762542] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.762692] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.762771] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.762944] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.763047] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.763101] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.763242] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.763320] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.763494] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.763593] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.763649] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.763780] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.763878] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.764029] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 59e1c3b9-919d-40eb-abaa-23f4746bb660 is going to be created. [ 1213.842396] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.842841] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.842841] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.842841] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.842966] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.920697] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 59e1c3b9-919d-40eb-abaa-23f4746bb660 in Status: IN_PROGRESS for 2s [ 1214.595101] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724 in Status: SUCCESS [ 1214.595293] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724 deletion is rescheduled due to dependency. [ 1214.595413] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.163263] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 in Status: SUCCESS [ 1215.163589] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 deletion is rescheduled due to dependency. [ 1215.163633] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.623919] env[68328]: INFO networking_nsxv3.common.synchronization [req-8fbbb9b3-c39b-447f-a59d-27cceea95c6d req-3e3c2eaa-5c3d-456c-b007-692fa4823f14 tempest-ServerDiskConfigTestJSON-155339900 tempest-ServerDiskConfigTestJSON-155339900-project-member] Enqueued Resource ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 with Priority: HIGHEST for action security_group_members [ 1215.625179] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 with Priority: HIGHEST for action security_group_members [ 1215.625461] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-261361c9-81c8-47fa-9a8a-4e37a8a439d7 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.625778] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.625857] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.626070] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.626231] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.626342] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.626409] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.626586] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.626671] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.626763] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('261361c9-81c8-47fa-9a8a-4e37a8a439d7',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.931841] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 59e1c3b9-919d-40eb-abaa-23f4746bb660 in Status: SUCCESS [ 1215.932126] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-59e1c3b9-919d-40eb-abaa-23f4746bb660" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.995753] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-754 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.995949] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-754" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.996093] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-754" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.996388] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-754" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.996647] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.996810] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.996931] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.997166] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.997323] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.997542] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1215.997662] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1215.997775] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1215.997887] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1215.998009] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1215.998128] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1215.998341] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1216.016727] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1216.016886] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1216.017035] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1216.017216] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-754" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.017489] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-5a28e185-87d7-4654-8702-0c4331f6ca4f taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.017652] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-5a28e185-87d7-4654-8702-0c4331f6ca4f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.017774] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-5a28e185-87d7-4654-8702-0c4331f6ca4f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.018082] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-5a28e185-87d7-4654-8702-0c4331f6ca4f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.018236] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a28e185-87d7-4654-8702-0c4331f6ca4f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.133720] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.133887] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.133930] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.134219] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.134312] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.134522] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.134622] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.134683] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.134839] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.134915] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.135015] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 is going to be updated. [ 1216.162199] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.162331] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.162414] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.162565] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.162701] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.172276] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 in Status: IN_PROGRESS for 2s [ 1216.520311] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.520536] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.520668] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.520969] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.521152] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.521316] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 5a28e185-87d7-4654-8702-0c4331f6ca4f not found, creating... [ 1216.521585] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.521749] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.521870] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.522146] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.522292] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.522666] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.522841] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.522965] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.523199] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.523342] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.523488] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 5a28e185-87d7-4654-8702-0c4331f6ca4f is going to be created. [ 1216.544705] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.544894] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.545018] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.545313] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.545546] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.545771] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-5a28e185-87d7-4654-8702-0c4331f6ca4f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.222624] env[68328]: INFO networking_nsxv3.common.synchronization [req-8fbbb9b3-c39b-447f-a59d-27cceea95c6d req-9c0bc5b5-4647-4455-abb0-ea726498975f service nova] Enqueued Resource ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 with Priority: HIGHEST for action security_group_rules [ 1217.222817] env[68328]: INFO networking_nsxv3.common.synchronization [req-8fbbb9b3-c39b-447f-a59d-27cceea95c6d req-9c0bc5b5-4647-4455-abb0-ea726498975f service nova] Enqueued Resource ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 with Priority: HIGHEST for action security_group_members [ 1217.222952] env[68328]: INFO networking_nsxv3.common.synchronization [req-8fbbb9b3-c39b-447f-a59d-27cceea95c6d req-9c0bc5b5-4647-4455-abb0-ea726498975f service nova] Enqueued Resource ID: 5a28e185-87d7-4654-8702-0c4331f6ca4f with Priority: HIGHEST for action port [ 1217.223268] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 with Priority: HIGHEST for action security_group_rules [ 1217.223400] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 with Priority: HIGHEST for action security_group_members [ 1217.223495] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a28e185-87d7-4654-8702-0c4331f6ca4f with Priority: HIGHEST for action port [ 1217.224156] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-261361c9-81c8-47fa-9a8a-4e37a8a439d7 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.224305] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.224392] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.224565] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.224643] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('261361c9-81c8-47fa-9a8a-4e37a8a439d7',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.225502] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-261361c9-81c8-47fa-9a8a-4e37a8a439d7 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.225601] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.226154] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-5a28e185-87d7-4654-8702-0c4331f6ca4f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.226244] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5a28e185-87d7-4654-8702-0c4331f6ca4f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.226316] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5a28e185-87d7-4654-8702-0c4331f6ca4f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.226503] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5a28e185-87d7-4654-8702-0c4331f6ca4f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.226583] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a28e185-87d7-4654-8702-0c4331f6ca4f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.728595] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-261361c9-81c8-47fa-9a8a-4e37a8a439d7 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.728994] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.729258] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5a28e185-87d7-4654-8702-0c4331f6ca4f with status ACTIVE [ 1217.729448] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.729587] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.729622] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.729860] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.729912] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.730095] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.730747] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.730821] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.731007] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.731097] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.734455] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.734564] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.734632] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.734791] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.734874] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.734952] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5a28e185-87d7-4654-8702-0c4331f6ca4f is going to be updated. [ 1217.762231] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.762412] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.762479] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.762657] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.762789] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.762948] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5a28e185-87d7-4654-8702-0c4331f6ca4f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.181615] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 in Status: SUCCESS [ 1218.181988] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 deletion is rescheduled due to dependency. [ 1218.182163] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.182416] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.182751] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.183046] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.183241] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.183366] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.183617] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.183747] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.183884] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('261361c9-81c8-47fa-9a8a-4e37a8a439d7',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.687521] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('261361c9-81c8-47fa-9a8a-4e37a8a439d7',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.189886] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('261361c9-81c8-47fa-9a8a-4e37a8a439d7',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.692245] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.692554] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.692554] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.692695] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.692786] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.692886] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 is going to be updated. [ 1219.703223] env[68328]: INFO networking_nsxv3.common.synchronization [req-4abdb818-17e0-41bb-9a5d-6148981de3bf req-5ed8f586-b3d9-4b3b-802a-7a6a561ef184 tempest-AttachVolumeShelveTestJSON-1223620556 tempest-AttachVolumeShelveTestJSON-1223620556-project-member] Enqueued Resource ID: b1c2fa85-ca03-4043-a12f-6ed71cf5c151 with Priority: HIGHEST for action security_group_members [ 1219.703929] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1c2fa85-ca03-4043-a12f-6ed71cf5c151 with Priority: HIGHEST for action security_group_members [ 1219.704429] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1c2fa85-ca03-4043-a12f-6ed71cf5c151 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.704605] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1c2fa85-ca03-4043-a12f-6ed71cf5c151" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.704711] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1c2fa85-ca03-4043-a12f-6ed71cf5c151" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.705234] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1c2fa85-ca03-4043-a12f-6ed71cf5c151" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.705430] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.705540] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.705606] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.705773] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.705849] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.705934] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1c2fa85-ca03-4043-a12f-6ed71cf5c151',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.723781] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.723781] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.724167] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.724167] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.724280] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.734503] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 in Status: IN_PROGRESS for 2s [ 1219.987221] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-194 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.987427] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-194" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.987555] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-194" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.987849] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-194" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.988331] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.988442] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.988555] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.988863] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.988933] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.989175] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1219.989266] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1219.989381] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1219.989482] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1219.989636] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1219.989693] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1219.989826] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1220.008625] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1220.008858] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1220.009101] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1220.009340] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-194" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.009659] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-774af91e-05b5-47ed-a1b2-a75901be965f taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.009839] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-774af91e-05b5-47ed-a1b2-a75901be965f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.009964] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-774af91e-05b5-47ed-a1b2-a75901be965f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.010297] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-774af91e-05b5-47ed-a1b2-a75901be965f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.010443] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('774af91e-05b5-47ed-a1b2-a75901be965f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.208253] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.208438] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.208491] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.208691] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.208780] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.208979] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.209085] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.209149] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.209299] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.209374] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.209465] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1c2fa85-ca03-4043-a12f-6ed71cf5c151 already deleted. [ 1220.209542] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1c2fa85-ca03-4043-a12f-6ed71cf5c151" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.512501] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.512720] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.512850] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.513175] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.513367] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.513527] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 774af91e-05b5-47ed-a1b2-a75901be965f not found, creating... [ 1220.513781] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.513947] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.514128] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.514367] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.514513] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.514800] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.514959] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.515095] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.515306] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.515442] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.515585] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 774af91e-05b5-47ed-a1b2-a75901be965f is going to be created. [ 1220.534621] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.534804] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.534931] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.535194] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.535414] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.535631] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-774af91e-05b5-47ed-a1b2-a75901be965f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.219363] env[68328]: INFO networking_nsxv3.common.synchronization [req-4abdb818-17e0-41bb-9a5d-6148981de3bf req-ce7b9b96-990b-4aa4-ab6c-96d9016210e3 service nova] Enqueued Resource ID: b1c2fa85-ca03-4043-a12f-6ed71cf5c151 with Priority: HIGHEST for action security_group_rules [ 1221.219668] env[68328]: INFO networking_nsxv3.common.synchronization [req-4abdb818-17e0-41bb-9a5d-6148981de3bf req-ce7b9b96-990b-4aa4-ab6c-96d9016210e3 service nova] Enqueued Resource ID: b1c2fa85-ca03-4043-a12f-6ed71cf5c151 with Priority: HIGHEST for action security_group_members [ 1221.219794] env[68328]: INFO networking_nsxv3.common.synchronization [req-4abdb818-17e0-41bb-9a5d-6148981de3bf req-ce7b9b96-990b-4aa4-ab6c-96d9016210e3 service nova] Enqueued Resource ID: 774af91e-05b5-47ed-a1b2-a75901be965f with Priority: HIGHEST for action port [ 1221.219919] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1c2fa85-ca03-4043-a12f-6ed71cf5c151 with Priority: HIGHEST for action security_group_rules [ 1221.220058] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1c2fa85-ca03-4043-a12f-6ed71cf5c151 with Priority: HIGHEST for action security_group_members [ 1221.220153] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 774af91e-05b5-47ed-a1b2-a75901be965f with Priority: HIGHEST for action port [ 1221.220700] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1c2fa85-ca03-4043-a12f-6ed71cf5c151 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.220823] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1c2fa85-ca03-4043-a12f-6ed71cf5c151" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.220895] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1c2fa85-ca03-4043-a12f-6ed71cf5c151" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.221097] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1c2fa85-ca03-4043-a12f-6ed71cf5c151" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.221179] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1c2fa85-ca03-4043-a12f-6ed71cf5c151',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.222063] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1c2fa85-ca03-4043-a12f-6ed71cf5c151 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.222215] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1c2fa85-ca03-4043-a12f-6ed71cf5c151" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.222268] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1c2fa85-ca03-4043-a12f-6ed71cf5c151" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.223026] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1c2fa85-ca03-4043-a12f-6ed71cf5c151" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.223026] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.223026] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.223026] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.223026] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.223026] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.223026] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1c2fa85-ca03-4043-a12f-6ed71cf5c151',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.223963] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-774af91e-05b5-47ed-a1b2-a75901be965f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.224076] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-774af91e-05b5-47ed-a1b2-a75901be965f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.224140] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-774af91e-05b5-47ed-a1b2-a75901be965f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.224282] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-774af91e-05b5-47ed-a1b2-a75901be965f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.224385] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('774af91e-05b5-47ed-a1b2-a75901be965f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.726027] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b1c2fa85-ca03-4043-a12f-6ed71cf5c151',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.727178] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1c2fa85-ca03-4043-a12f-6ed71cf5c151 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.727373] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1c2fa85-ca03-4043-a12f-6ed71cf5c151" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.728789] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 774af91e-05b5-47ed-a1b2-a75901be965f with status ACTIVE [ 1221.728981] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.729075] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.729153] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.729420] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.729420] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.729589] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.729703] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.729789] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.729972] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.729972] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.730663] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.730804] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.730871] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.731472] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.731472] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.731472] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 774af91e-05b5-47ed-a1b2-a75901be965f is going to be updated. [ 1221.744314] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 in Status: SUCCESS [ 1221.744560] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.744704] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.744974] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.745254] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.745556] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.745556] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.745556] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.745770] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.745770] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.745770] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('261361c9-81c8-47fa-9a8a-4e37a8a439d7',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.774058] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.774058] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.774058] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.774058] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.774574] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.774574] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-774af91e-05b5-47ed-a1b2-a75901be965f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.229721] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b1c2fa85-ca03-4043-a12f-6ed71cf5c151',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.247843] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-261361c9-81c8-47fa-9a8a-4e37a8a439d7 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.248308] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.248308] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.248308] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.248438] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.248543] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.248599] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.248741] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.248823] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.248909] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.249066] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-261361c9-81c8-47fa-9a8a-4e37a8a439d7 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.249158] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.249221] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.249360] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.249493] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.249581] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.249638] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.249770] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.249841] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.249919] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.250010] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('261361c9-81c8-47fa-9a8a-4e37a8a439d7',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.733790] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.733986] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.734137] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.734354] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.734450] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.734548] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1c2fa85-ca03-4043-a12f-6ed71cf5c151 is going to be created. [ 1222.752314] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 261361c9-81c8-47fa-9a8a-4e37a8a439d7: rpc.has_security_group_logging(os_id): False [ 1222.767561] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.767716] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.767802] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.768032] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.768218] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.770245] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.770377] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.770453] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.770641] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.770747] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.770973] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.771103] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.771181] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.771338] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.771429] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.771627] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.771735] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.771796] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.771958] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.772067] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.772305] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.772420] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.772493] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.772660] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.772748] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.772843] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 is going to be updated. [ 1222.781593] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1c2fa85-ca03-4043-a12f-6ed71cf5c151 in Status: UNINITIALIZED for 2s [ 1222.838345] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.838547] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.838547] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.838758] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.838900] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.859908] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 in Status: IN_PROGRESS for 2s [ 1224.617195] env[68328]: INFO networking_nsxv3.common.synchronization [req-4457d83f-f6b8-4abd-b706-fdea5608adc4 req-41bbcaca-e724-4edd-a6e0-30d28ca5d8a2 tempest-ServersTestJSON-1771388484 tempest-ServersTestJSON-1771388484-project-member] Enqueued Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_members [ 1224.617733] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_members [ 1224.617733] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-5841566c-1d05-4389-b8a7-950b5f9c6708 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.617868] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.617985] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.618149] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.618871] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.618871] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.618871] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.619026] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.619138] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.619200] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.791089] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1c2fa85-ca03-4043-a12f-6ed71cf5c151 in Status: SUCCESS [ 1224.791575] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1c2fa85-ca03-4043-a12f-6ed71cf5c151" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.791850] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1c2fa85-ca03-4043-a12f-6ed71cf5c151" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.792161] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1c2fa85-ca03-4043-a12f-6ed71cf5c151" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.792436] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.792601] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.792706] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.792906] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.793059] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.793195] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1c2fa85-ca03-4043-a12f-6ed71cf5c151" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.793326] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b1c2fa85-ca03-4043-a12f-6ed71cf5c151',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.877572] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 in Status: SUCCESS [ 1224.877572] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.932834] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-384 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.932834] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-384" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.932834] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-384" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.933067] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-384" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.933229] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.933397] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.933521] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.933749] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.933898] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.934215] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1224.934320] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1224.934433] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1224.934549] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1224.934665] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1224.934776] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1224.934912] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1224.955027] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1224.955027] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1224.955027] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1224.955027] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-384" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.955383] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-44d18c53-3f3a-4691-baba-85c412cd7b3c taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.955498] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-44d18c53-3f3a-4691-baba-85c412cd7b3c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.955661] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-44d18c53-3f3a-4691-baba-85c412cd7b3c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.958856] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-44d18c53-3f3a-4691-baba-85c412cd7b3c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.958856] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44d18c53-3f3a-4691-baba-85c412cd7b3c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.125027] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.295575] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b1c2fa85-ca03-4043-a12f-6ed71cf5c151',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.319514] env[68328]: INFO networking_nsxv3.common.synchronization [req-65e1cc36-6316-42b4-bc27-778103d98279 req-c54df2f5-7360-4c70-b929-b9936c25208e tempest-ServerActionsTestOtherA-501294167 tempest-ServerActionsTestOtherA-501294167-project-member] Enqueued Resource ID: 1b5440d1-45ae-41d0-a9b6-24cc237ec6a2 with Priority: HIGHEST for action security_group_members [ 1225.319818] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b5440d1-45ae-41d0-a9b6-24cc237ec6a2 with Priority: HIGHEST for action security_group_members [ 1225.320079] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b5440d1-45ae-41d0-a9b6-24cc237ec6a2 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.320162] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b5440d1-45ae-41d0-a9b6-24cc237ec6a2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.320228] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b5440d1-45ae-41d0-a9b6-24cc237ec6a2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.320430] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b5440d1-45ae-41d0-a9b6-24cc237ec6a2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.320617] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.320817] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.320913] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.321669] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.321669] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.321669] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b5440d1-45ae-41d0-a9b6-24cc237ec6a2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.458906] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.459157] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.459405] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.459723] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.459887] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.460059] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 44d18c53-3f3a-4691-baba-85c412cd7b3c not found, creating... [ 1225.460385] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.460548] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.460669] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.460901] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.461086] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.461412] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.461577] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.461702] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.461919] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.462071] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.462232] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 44d18c53-3f3a-4691-baba-85c412cd7b3c is going to be created. [ 1225.492778] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.493010] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.493146] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.493435] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.493669] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.493904] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-44d18c53-3f3a-4691-baba-85c412cd7b3c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.628752] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.721642] env[68328]: INFO networking_nsxv3.common.synchronization [req-49abb22b-0661-4256-9cff-7ee8f1ef8da9 req-7b57c18f-191f-4373-8f65-1c6714fec432 tempest-InstanceActionsTestJSON-1807673419 tempest-InstanceActionsTestJSON-1807673419-project-member] Enqueued Resource ID: 59e1c3b9-919d-40eb-abaa-23f4746bb660 with Priority: HIGHEST for action security_group_members [ 1225.723029] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59e1c3b9-919d-40eb-abaa-23f4746bb660 with Priority: HIGHEST for action security_group_members [ 1225.723029] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-59e1c3b9-919d-40eb-abaa-23f4746bb660 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.723029] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59e1c3b9-919d-40eb-abaa-23f4746bb660" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.723029] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59e1c3b9-919d-40eb-abaa-23f4746bb660" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.723513] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59e1c3b9-919d-40eb-abaa-23f4746bb660" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.723771] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.723972] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.724184] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.725779] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.725779] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.725779] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59e1c3b9-919d-40eb-abaa-23f4746bb660',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.798977] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b1c2fa85-ca03-4043-a12f-6ed71cf5c151: rpc.has_security_group_logging(os_id): False [ 1225.817802] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.817977] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.818068] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.818394] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.818520] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.818794] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.818910] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.818966] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.819195] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.819248] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.819336] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1c2fa85-ca03-4043-a12f-6ed71cf5c151 is going to be created. [ 1225.824049] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.824241] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.824241] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.824413] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.824494] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.824670] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.824765] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.824826] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.824966] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.825052] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.825138] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b5440d1-45ae-41d0-a9b6-24cc237ec6a2 is going to be updated. [ 1225.852896] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.853061] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.853131] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.853337] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.853472] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.863140] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b5440d1-45ae-41d0-a9b6-24cc237ec6a2 in Status: IN_PROGRESS for 2s [ 1225.885984] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.886157] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.886210] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.888449] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.888449] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.898760] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1c2fa85-ca03-4043-a12f-6ed71cf5c151 in Status: IN_PROGRESS for 2s [ 1226.133139] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.133139] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.133139] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.133139] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.133139] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.133139] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 is going to be updated. [ 1226.162188] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.162329] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.162399] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.162609] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.162748] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.183096] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: IN_PROGRESS for 2s [ 1226.228271] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.228734] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.228734] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.228864] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.228911] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.229090] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.229193] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.229241] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.229395] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.229464] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.229552] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59e1c3b9-919d-40eb-abaa-23f4746bb660 is going to be updated. [ 1226.264693] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.264881] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.264881] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.265112] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.265254] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.286492] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59e1c3b9-919d-40eb-abaa-23f4746bb660 in Status: IN_PROGRESS for 2s [ 1226.388597] env[68328]: INFO networking_nsxv3.common.synchronization [req-4457d83f-f6b8-4abd-b706-fdea5608adc4 req-e4a114c9-4664-44f6-851e-1b838bc6abd1 service nova] Enqueued Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_rules [ 1226.389553] env[68328]: INFO networking_nsxv3.common.synchronization [req-4457d83f-f6b8-4abd-b706-fdea5608adc4 req-e4a114c9-4664-44f6-851e-1b838bc6abd1 service nova] Enqueued Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_members [ 1226.389553] env[68328]: INFO networking_nsxv3.common.synchronization [req-4457d83f-f6b8-4abd-b706-fdea5608adc4 req-e4a114c9-4664-44f6-851e-1b838bc6abd1 service nova] Enqueued Resource ID: 44d18c53-3f3a-4691-baba-85c412cd7b3c with Priority: HIGHEST for action port [ 1226.389553] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_rules [ 1226.389553] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_members [ 1226.389553] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44d18c53-3f3a-4691-baba-85c412cd7b3c with Priority: HIGHEST for action port [ 1226.389975] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5841566c-1d05-4389-b8a7-950b5f9c6708 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.392034] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.392034] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.392034] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.392034] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.392901] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-5841566c-1d05-4389-b8a7-950b5f9c6708 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.392901] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.393094] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-44d18c53-3f3a-4691-baba-85c412cd7b3c taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.393253] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-44d18c53-3f3a-4691-baba-85c412cd7b3c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.393343] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-44d18c53-3f3a-4691-baba-85c412cd7b3c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.393527] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-44d18c53-3f3a-4691-baba-85c412cd7b3c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.393600] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44d18c53-3f3a-4691-baba-85c412cd7b3c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.895795] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-5841566c-1d05-4389-b8a7-950b5f9c6708 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.896095] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.896167] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 44d18c53-3f3a-4691-baba-85c412cd7b3c with status ACTIVE [ 1226.896343] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.896487] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.896550] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.896728] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.896819] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.896987] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.897097] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.897158] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.897312] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.897411] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.897564] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.897856] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.897856] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.897856] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.897940] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.897968] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 44d18c53-3f3a-4691-baba-85c412cd7b3c is going to be updated. [ 1226.924659] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.924804] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.924874] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.925083] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.925220] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.925405] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-44d18c53-3f3a-4691-baba-85c412cd7b3c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.872206] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b5440d1-45ae-41d0-a9b6-24cc237ec6a2 in Status: SUCCESS [ 1227.872370] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b5440d1-45ae-41d0-a9b6-24cc237ec6a2 deletion is rescheduled due to dependency. [ 1227.872459] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b5440d1-45ae-41d0-a9b6-24cc237ec6a2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.911439] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1c2fa85-ca03-4043-a12f-6ed71cf5c151 in Status: SUCCESS [ 1227.911439] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1c2fa85-ca03-4043-a12f-6ed71cf5c151" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.197761] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: SUCCESS [ 1228.198150] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.198427] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.198769] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.198974] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.199132] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.199242] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.199438] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.199569] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.199696] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.296575] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59e1c3b9-919d-40eb-abaa-23f4746bb660 in Status: SUCCESS [ 1228.296575] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59e1c3b9-919d-40eb-abaa-23f4746bb660 deletion is rescheduled due to dependency. [ 1228.296575] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59e1c3b9-919d-40eb-abaa-23f4746bb660" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.704085] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.206267] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.708151] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.709487] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.709487] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.709487] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.709487] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.709688] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 is going to be updated. [ 1229.739665] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.740042] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.740127] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.740337] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.740484] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.761569] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: IN_PROGRESS for 2s [ 1231.390324] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1231.390709] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1231.773297] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: SUCCESS [ 1231.773561] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.773732] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.773967] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.774233] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.774385] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.774517] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.774704] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.774808] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.774901] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.774991] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.997373] env[68328]: INFO networking_nsxv3.common.synchronization [req-1e119db4-58e9-432b-8701-d92ee1cf7517 req-c236a578-b309-4bcb-b6fe-e4475ea2001d tempest-ServerDiskConfigTestJSON-155339900 tempest-ServerDiskConfigTestJSON-155339900-project-member] Enqueued Resource ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 with Priority: HIGHEST for action security_group_members [ 1232.000338] env[68328]: INFO networking_nsxv3.common.synchronization [req-2e95e946-e643-45d3-b16e-7b4a40f94daa req-7f34847f-ca03-42ec-adf7-54dce25e89fa tempest-DeleteServersTestJSON-1696259291 tempest-DeleteServersTestJSON-1696259291-project-member] Enqueued Resource ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 with Priority: HIGHEST for action security_group_members [ 1232.001204] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 with Priority: HIGHEST for action security_group_members [ 1232.001316] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 with Priority: HIGHEST for action security_group_members [ 1232.001831] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-261361c9-81c8-47fa-9a8a-4e37a8a439d7 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.002743] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.002842] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.003204] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.003388] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.003496] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.003557] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.003832] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.003832] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.003927] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('261361c9-81c8-47fa-9a8a-4e37a8a439d7',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.005856] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.005989] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.006067] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.006314] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.006392] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.008671] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.008752] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.008964] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.009386] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.009386] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c35aa45-69e7-4952-b5d8-8a7d6b3460e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.279504] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-5841566c-1d05-4389-b8a7-950b5f9c6708 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.279678] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.279761] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.279959] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.280150] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.280252] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.280307] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.280450] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.280564] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.280622] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.280762] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-5841566c-1d05-4389-b8a7-950b5f9c6708 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.280852] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.280919] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.281055] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.281189] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.281277] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.281335] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.281467] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.281541] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.281617] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.281703] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.512637] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.512637] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.512637] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.512637] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.512637] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.512637] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.512637] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.512637] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.512637] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.512637] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.513341] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 is going to be updated. [ 1232.513846] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.513960] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.514040] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.514190] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.514290] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.514461] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.514663] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.514663] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.514776] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.514812] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.514904] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 is going to be updated. [ 1232.546725] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.546888] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.546958] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.547189] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.547320] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.548937] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.549065] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.549131] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.549293] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.549405] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.559316] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 in Status: IN_PROGRESS for 2s [ 1232.560053] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 in Status: IN_PROGRESS for 2s [ 1232.784178] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5841566c-1d05-4389-b8a7-950b5f9c6708: rpc.has_security_group_logging(os_id): False [ 1232.802214] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.802386] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.802436] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.802648] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.802741] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.802956] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.803069] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.803129] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.803321] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.803390] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.803532] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.803627] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.803691] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.803824] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.804011] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.804086] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.804177] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.804252] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.804398] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.804473] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.804557] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 is going to be updated. [ 1232.867571] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.867721] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.867783] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.868009] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.868161] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.887889] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: IN_PROGRESS for 2s [ 1234.365540] env[68328]: INFO networking_nsxv3.common.synchronization [None req-b338be50-6eb8-443e-8cce-e96b669b5837 None None] Enqueued Resource ID: 9adb0bd9-8f63-43ed-bc1b-0929b202babb with Priority: HIGHEST for action port [ 1234.365825] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9adb0bd9-8f63-43ed-bc1b-0929b202babb with Priority: HIGHEST for action port [ 1234.370020] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-9adb0bd9-8f63-43ed-bc1b-0929b202babb taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.370020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9adb0bd9-8f63-43ed-bc1b-0929b202babb" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.370020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9adb0bd9-8f63-43ed-bc1b-0929b202babb" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.370020] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9adb0bd9-8f63-43ed-bc1b-0929b202babb" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.370020] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9adb0bd9-8f63-43ed-bc1b-0929b202babb',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.580282] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 in Status: SUCCESS [ 1234.580469] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 deletion is rescheduled due to dependency. [ 1234.580635] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.581425] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 in Status: SUCCESS [ 1234.581555] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 deletion is rescheduled due to dependency. [ 1234.581657] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.869310] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9adb0bd9-8f63-43ed-bc1b-0929b202babb [ 1234.869547] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.869676] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.869783] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.869949] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.870051] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.870151] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9adb0bd9-8f63-43ed-bc1b-0929b202babb already deleted. [ 1234.870231] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9adb0bd9-8f63-43ed-bc1b-0929b202babb" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.905582] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: SUCCESS [ 1234.905818] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.890018] env[68328]: INFO networking_nsxv3.common.synchronization [req-ba5562ef-d74c-4acb-b8b4-7443f322b5ac req-eea3ca9b-3ff9-4116-a474-25366e725ccd tempest-ServerActionsTestOtherA-501294167 tempest-ServerActionsTestOtherA-501294167-project-member] Enqueued Resource ID: d7acb0b1-c9e7-4016-8d0b-c700463d32e1 with Priority: HIGHEST for action security_group_members [ 1235.890018] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7acb0b1-c9e7-4016-8d0b-c700463d32e1 with Priority: HIGHEST for action security_group_members [ 1235.890018] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.892093] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.892370] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.892671] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.892933] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.893225] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.893443] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.893811] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.893991] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.894187] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7acb0b1-c9e7-4016-8d0b-c700463d32e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.183669] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-113 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.183897] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-113" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.184105] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-113" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.184398] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-113" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.184705] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.185081] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.185081] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.185785] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.185785] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.185785] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1236.185785] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1236.185987] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1236.186327] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1236.186327] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1236.186426] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1236.186717] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1236.208446] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1236.208785] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1236.208963] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1236.209099] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-113" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.209413] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-bcbe5c54-0ff3-4b40-9b71-b55511163ea4 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.209583] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-bcbe5c54-0ff3-4b40-9b71-b55511163ea4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.209729] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-bcbe5c54-0ff3-4b40-9b71-b55511163ea4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.210101] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-bcbe5c54-0ff3-4b40-9b71-b55511163ea4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.210257] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcbe5c54-0ff3-4b40-9b71-b55511163ea4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.401496] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.401496] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.401496] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.401496] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.401496] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.401496] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.401496] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.401496] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.401496] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.401496] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.401496] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7acb0b1-c9e7-4016-8d0b-c700463d32e1 is going to be deleted. [ 1236.440099] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.440099] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.440099] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.440099] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.440099] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.440099] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.663164] env[68328]: INFO networking_nsxv3.common.synchronization [None req-f3abc7d5-3cee-4e8a-a864-e12eaf98753b None None] Enqueued Resource ID: 4ef66a27-f588-489a-a8af-8f9c98470b98 with Priority: HIGHEST for action port [ 1236.663428] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ef66a27-f588-489a-a8af-8f9c98470b98 with Priority: HIGHEST for action port [ 1236.663983] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-4ef66a27-f588-489a-a8af-8f9c98470b98 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.664107] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4ef66a27-f588-489a-a8af-8f9c98470b98" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.664201] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4ef66a27-f588-489a-a8af-8f9c98470b98" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.664482] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4ef66a27-f588-489a-a8af-8f9c98470b98" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.665196] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ef66a27-f588-489a-a8af-8f9c98470b98',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.713125] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.713341] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.713468] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.713742] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.713895] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.714070] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port bcbe5c54-0ff3-4b40-9b71-b55511163ea4 not found, creating... [ 1236.714382] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.714551] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.714672] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.714891] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.715041] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.715382] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.715574] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.715816] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.716064] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.716211] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.716360] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: bcbe5c54-0ff3-4b40-9b71-b55511163ea4 is going to be created. [ 1236.744346] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.744583] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.744703] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.744938] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.745186] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.745416] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-bcbe5c54-0ff3-4b40-9b71-b55511163ea4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.167179] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4ef66a27-f588-489a-a8af-8f9c98470b98 [ 1237.167502] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.167679] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.167779] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.168038] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.168159] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.168282] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4ef66a27-f588-489a-a8af-8f9c98470b98 already deleted. [ 1237.168395] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4ef66a27-f588-489a-a8af-8f9c98470b98" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.448999] env[68328]: INFO networking_nsxv3.common.synchronization [req-ba5562ef-d74c-4acb-b8b4-7443f322b5ac req-cea5aab7-3c3a-4e5d-bab2-297e801565d1 service nova] Enqueued Resource ID: d7acb0b1-c9e7-4016-8d0b-c700463d32e1 with Priority: HIGHEST for action security_group_rules [ 1237.449171] env[68328]: INFO networking_nsxv3.common.synchronization [req-ba5562ef-d74c-4acb-b8b4-7443f322b5ac req-cea5aab7-3c3a-4e5d-bab2-297e801565d1 service nova] Enqueued Resource ID: d7acb0b1-c9e7-4016-8d0b-c700463d32e1 with Priority: HIGHEST for action security_group_members [ 1237.450399] env[68328]: INFO networking_nsxv3.common.synchronization [req-ba5562ef-d74c-4acb-b8b4-7443f322b5ac req-cea5aab7-3c3a-4e5d-bab2-297e801565d1 service nova] Enqueued Resource ID: bcbe5c54-0ff3-4b40-9b71-b55511163ea4 with Priority: HIGHEST for action port [ 1237.450399] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7acb0b1-c9e7-4016-8d0b-c700463d32e1 with Priority: HIGHEST for action security_group_rules [ 1237.450399] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7acb0b1-c9e7-4016-8d0b-c700463d32e1 with Priority: HIGHEST for action security_group_members [ 1237.450399] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcbe5c54-0ff3-4b40-9b71-b55511163ea4 with Priority: HIGHEST for action port [ 1237.452900] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d7acb0b1-c9e7-4016-8d0b-c700463d32e1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.452900] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.452900] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.452900] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.452900] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d7acb0b1-c9e7-4016-8d0b-c700463d32e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.453934] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.455038] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.455038] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.455038] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.455038] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.455038] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.455038] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.455038] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.455038] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.455038] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7acb0b1-c9e7-4016-8d0b-c700463d32e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.456153] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-bcbe5c54-0ff3-4b40-9b71-b55511163ea4 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.456153] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bcbe5c54-0ff3-4b40-9b71-b55511163ea4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.456153] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bcbe5c54-0ff3-4b40-9b71-b55511163ea4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.456283] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bcbe5c54-0ff3-4b40-9b71-b55511163ea4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.456354] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcbe5c54-0ff3-4b40-9b71-b55511163ea4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.958654] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.958654] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.958877] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d7acb0b1-c9e7-4016-8d0b-c700463d32e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.962603] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bcbe5c54-0ff3-4b40-9b71-b55511163ea4 with status ACTIVE [ 1237.962603] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.962603] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.962603] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.962603] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.962603] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.963089] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.963089] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.963089] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.963089] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.963311] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.963570] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.963720] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.963785] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.963929] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.964202] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.964350] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bcbe5c54-0ff3-4b40-9b71-b55511163ea4 is going to be updated. [ 1237.986502] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.986665] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.986738] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.987031] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.987175] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.987339] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bcbe5c54-0ff3-4b40-9b71-b55511163ea4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.461548] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d7acb0b1-c9e7-4016-8d0b-c700463d32e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.963672] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.963836] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.963917] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.964157] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.964615] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.964615] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7acb0b1-c9e7-4016-8d0b-c700463d32e1 is going to be created. [ 1238.992022] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.992022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.992022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.992022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.992022] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.003023] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7acb0b1-c9e7-4016-8d0b-c700463d32e1 in Status: UNINITIALIZED for 2s [ 1240.117042] env[68328]: INFO networking_nsxv3.common.synchronization [req-95078643-72ba-4093-ba7d-4a6e2ae7aa2b req-048853e7-c135-4868-8bf6-a91e3554f9f4 tempest-ServerPasswordTestJSON-867773349 tempest-ServerPasswordTestJSON-867773349-project-member] Enqueued Resource ID: 6b8aa55c-e36f-4c45-be83-62ef79342d52 with Priority: HIGHEST for action security_group_members [ 1240.117611] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b8aa55c-e36f-4c45-be83-62ef79342d52 with Priority: HIGHEST for action security_group_members [ 1240.117941] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b8aa55c-e36f-4c45-be83-62ef79342d52 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.118724] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b8aa55c-e36f-4c45-be83-62ef79342d52" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.118724] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b8aa55c-e36f-4c45-be83-62ef79342d52" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.118983] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b8aa55c-e36f-4c45-be83-62ef79342d52" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.119327] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.119327] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.119468] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.120501] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.120501] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.120501] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b8aa55c-e36f-4c45-be83-62ef79342d52',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.455930] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-225 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.456150] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-225" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.456284] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-225" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.456670] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-225" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.456946] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.457124] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.457247] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.457472] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.457621] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.457938] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1240.457938] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1240.458061] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1240.458174] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1240.458299] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1240.458393] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1240.458529] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1240.487908] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1240.488110] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1240.488257] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1240.488436] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-225" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.488781] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-d61f12e6-746b-410f-9a77-cb2fe16a97ba taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.488960] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-d61f12e6-746b-410f-9a77-cb2fe16a97ba" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.489097] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-d61f12e6-746b-410f-9a77-cb2fe16a97ba" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.489467] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-d61f12e6-746b-410f-9a77-cb2fe16a97ba" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.489705] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d61f12e6-746b-410f-9a77-cb2fe16a97ba',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.623554] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.623554] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.623554] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.623554] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.623554] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.623554] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.623554] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.623554] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.623554] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.623554] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.623554] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b8aa55c-e36f-4c45-be83-62ef79342d52 already deleted. [ 1240.623554] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b8aa55c-e36f-4c45-be83-62ef79342d52" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.992359] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.992792] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.992792] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.993069] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.993228] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.993393] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port d61f12e6-746b-410f-9a77-cb2fe16a97ba not found, creating... [ 1240.993666] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.993867] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.993939] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.994175] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.994336] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.994624] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.994784] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.994905] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.995262] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.995377] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.995535] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: d61f12e6-746b-410f-9a77-cb2fe16a97ba is going to be created. [ 1241.011615] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7acb0b1-c9e7-4016-8d0b-c700463d32e1 in Status: SUCCESS [ 1241.011805] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.011967] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.012186] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.012380] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.012491] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.012552] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.012702] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.012782] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.012861] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.012950] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d7acb0b1-c9e7-4016-8d0b-c700463d32e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.015189] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.015395] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.015533] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.015759] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.015980] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.016206] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-d61f12e6-746b-410f-9a77-cb2fe16a97ba" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.514966] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.515307] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.515307] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.515514] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.515703] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.515821] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.515886] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.516068] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.516158] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.516255] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.516406] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.516501] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.516564] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.516710] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.516841] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.516930] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.516989] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.517135] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.517209] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.517288] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.517373] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d7acb0b1-c9e7-4016-8d0b-c700463d32e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.785247] env[68328]: INFO networking_nsxv3.common.synchronization [req-95078643-72ba-4093-ba7d-4a6e2ae7aa2b req-990618bc-3dd9-4d3b-8dc9-b742574b5fe5 service nova] Enqueued Resource ID: 6b8aa55c-e36f-4c45-be83-62ef79342d52 with Priority: HIGHEST for action security_group_rules [ 1241.785247] env[68328]: INFO networking_nsxv3.common.synchronization [req-95078643-72ba-4093-ba7d-4a6e2ae7aa2b req-990618bc-3dd9-4d3b-8dc9-b742574b5fe5 service nova] Enqueued Resource ID: 6b8aa55c-e36f-4c45-be83-62ef79342d52 with Priority: HIGHEST for action security_group_members [ 1241.785247] env[68328]: INFO networking_nsxv3.common.synchronization [req-95078643-72ba-4093-ba7d-4a6e2ae7aa2b req-990618bc-3dd9-4d3b-8dc9-b742574b5fe5 service nova] Enqueued Resource ID: d61f12e6-746b-410f-9a77-cb2fe16a97ba with Priority: HIGHEST for action port [ 1241.792116] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b8aa55c-e36f-4c45-be83-62ef79342d52 with Priority: HIGHEST for action security_group_rules [ 1241.792116] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b8aa55c-e36f-4c45-be83-62ef79342d52 with Priority: HIGHEST for action security_group_members [ 1241.792116] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d61f12e6-746b-410f-9a77-cb2fe16a97ba with Priority: HIGHEST for action port [ 1241.792116] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b8aa55c-e36f-4c45-be83-62ef79342d52 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.792116] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b8aa55c-e36f-4c45-be83-62ef79342d52" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.792116] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b8aa55c-e36f-4c45-be83-62ef79342d52" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.793106] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b8aa55c-e36f-4c45-be83-62ef79342d52" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.793268] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b8aa55c-e36f-4c45-be83-62ef79342d52',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.795435] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b8aa55c-e36f-4c45-be83-62ef79342d52 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.795435] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b8aa55c-e36f-4c45-be83-62ef79342d52" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.795587] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b8aa55c-e36f-4c45-be83-62ef79342d52" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.796119] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b8aa55c-e36f-4c45-be83-62ef79342d52" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.796324] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.796470] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.796562] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.797969] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.798134] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.798277] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b8aa55c-e36f-4c45-be83-62ef79342d52',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.800341] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-d61f12e6-746b-410f-9a77-cb2fe16a97ba taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.800341] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d61f12e6-746b-410f-9a77-cb2fe16a97ba" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.800341] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d61f12e6-746b-410f-9a77-cb2fe16a97ba" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.800341] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d61f12e6-746b-410f-9a77-cb2fe16a97ba" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.800341] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d61f12e6-746b-410f-9a77-cb2fe16a97ba',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.019551] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d7acb0b1-c9e7-4016-8d0b-c700463d32e1: rpc.has_security_group_logging(os_id): False [ 1242.040443] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.040443] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.040443] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.040443] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.040443] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.040679] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.040728] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.040758] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.040905] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.040982] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.041176] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.041270] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.041332] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.041470] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.041538] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.041706] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.042100] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.042217] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.042376] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.042453] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.042538] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d7acb0b1-c9e7-4016-8d0b-c700463d32e1 is going to be created. [ 1242.106539] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.106539] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.106539] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.106762] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.106919] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.120300] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d7acb0b1-c9e7-4016-8d0b-c700463d32e1 in Status: IN_PROGRESS for 2s [ 1242.306336] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b8aa55c-e36f-4c45-be83-62ef79342d52',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.306336] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b8aa55c-e36f-4c45-be83-62ef79342d52 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.306336] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b8aa55c-e36f-4c45-be83-62ef79342d52" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.306336] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d61f12e6-746b-410f-9a77-cb2fe16a97ba with status ACTIVE [ 1242.306336] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.306336] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.306336] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.306336] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.306336] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.306336] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.306336] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.306336] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.306336] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.306336] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.306805] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.307125] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.307303] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.307521] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.307676] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.307829] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d61f12e6-746b-410f-9a77-cb2fe16a97ba is going to be updated. [ 1242.333725] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.333865] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.333936] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.334166] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.334337] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.334548] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d61f12e6-746b-410f-9a77-cb2fe16a97ba" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.805306] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b8aa55c-e36f-4c45-be83-62ef79342d52',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.307953] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.308128] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.308199] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.308421] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.308510] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.308611] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b8aa55c-e36f-4c45-be83-62ef79342d52 is going to be created. [ 1243.347517] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.347517] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.347517] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.347719] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.347719] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.357181] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b8aa55c-e36f-4c45-be83-62ef79342d52 in Status: UNINITIALIZED for 2s [ 1244.134088] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d7acb0b1-c9e7-4016-8d0b-c700463d32e1 in Status: SUCCESS [ 1244.134455] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.495359] env[68328]: INFO networking_nsxv3.common.synchronization [req-d918aa41-d73a-4226-b550-82bdd97ffa33 req-41f828d8-43fe-434e-bee5-00162e302814 tempest-ServersTestJSON-1771388484 tempest-ServersTestJSON-1771388484-project-member] Enqueued Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_members [ 1244.496371] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_members [ 1244.496371] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-5841566c-1d05-4389-b8a7-950b5f9c6708 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.496571] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.496571] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.496701] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.496890] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.497012] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.497078] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.497234] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.497310] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.497397] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.958484] env[68328]: INFO networking_nsxv3.common.synchronization [req-f874e52a-3169-4ab1-b28c-623a5e22b199 req-fa80dc4f-c63f-4ee1-b053-b125f56ba7bd tempest-ServerActionsTestOtherA-501294167 tempest-ServerActionsTestOtherA-501294167-project-member] Enqueued Resource ID: d7acb0b1-c9e7-4016-8d0b-c700463d32e1 with Priority: HIGHEST for action security_group_members [ 1244.958885] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7acb0b1-c9e7-4016-8d0b-c700463d32e1 with Priority: HIGHEST for action security_group_members [ 1244.959526] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.959652] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.959720] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.959924] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.960159] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.960289] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.960386] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.960539] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.960669] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.960751] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7acb0b1-c9e7-4016-8d0b-c700463d32e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.999209] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.007507] env[68328]: INFO networking_nsxv3.common.synchronization [req-f874e52a-3169-4ab1-b28c-623a5e22b199 req-fa80dc4f-c63f-4ee1-b053-b125f56ba7bd tempest-ServerActionsTestOtherA-501294167 tempest-ServerActionsTestOtherA-501294167-project-member] Enqueued Resource ID: bcbe5c54-0ff3-4b40-9b71-b55511163ea4 with Priority: HIGHEST for action port [ 1245.008022] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcbe5c54-0ff3-4b40-9b71-b55511163ea4 with Priority: HIGHEST for action port [ 1245.008330] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-bcbe5c54-0ff3-4b40-9b71-b55511163ea4 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.008450] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bcbe5c54-0ff3-4b40-9b71-b55511163ea4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.008518] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bcbe5c54-0ff3-4b40-9b71-b55511163ea4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.008722] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bcbe5c54-0ff3-4b40-9b71-b55511163ea4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.008813] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcbe5c54-0ff3-4b40-9b71-b55511163ea4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.366164] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b8aa55c-e36f-4c45-be83-62ef79342d52 in Status: SUCCESS [ 1245.366398] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b8aa55c-e36f-4c45-be83-62ef79342d52" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.366627] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b8aa55c-e36f-4c45-be83-62ef79342d52" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.366873] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b8aa55c-e36f-4c45-be83-62ef79342d52" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.367081] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.367208] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.367243] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.367388] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.367476] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.367562] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b8aa55c-e36f-4c45-be83-62ef79342d52" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.367651] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6b8aa55c-e36f-4c45-be83-62ef79342d52',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.462827] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.463090] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.463214] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.463560] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.463709] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.463990] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.464155] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.464252] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.464496] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.464622] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.464753] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7acb0b1-c9e7-4016-8d0b-c700463d32e1 is going to be updated. [ 1245.491358] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.491506] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.491579] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.491780] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.491921] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.499948] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7acb0b1-c9e7-4016-8d0b-c700463d32e1 in Status: IN_PROGRESS for 2s [ 1245.501294] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.510254] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bcbe5c54-0ff3-4b40-9b71-b55511163ea4 with status ACTIVE [ 1245.510458] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.510580] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.510648] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.510839] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.510929] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.511128] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.511229] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.511287] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.511437] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.511514] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.511709] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.511815] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.511875] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.512550] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.512641] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.512731] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bcbe5c54-0ff3-4b40-9b71-b55511163ea4 is going to be updated. [ 1245.532043] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.532174] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.532265] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.532446] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.532572] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.532722] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bcbe5c54-0ff3-4b40-9b71-b55511163ea4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.870681] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b8aa55c-e36f-4c45-be83-62ef79342d52 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.870817] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b8aa55c-e36f-4c45-be83-62ef79342d52" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.870817] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b8aa55c-e36f-4c45-be83-62ef79342d52" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.870985] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b8aa55c-e36f-4c45-be83-62ef79342d52" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.871166] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.871263] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.871325] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.871478] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.872310] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.872310] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b8aa55c-e36f-4c45-be83-62ef79342d52" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.872310] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b8aa55c-e36f-4c45-be83-62ef79342d52 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.872310] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b8aa55c-e36f-4c45-be83-62ef79342d52" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.872310] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b8aa55c-e36f-4c45-be83-62ef79342d52" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.872310] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b8aa55c-e36f-4c45-be83-62ef79342d52" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.872310] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.872520] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.872520] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.872834] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.872834] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.872966] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b8aa55c-e36f-4c45-be83-62ef79342d52" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.872966] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6b8aa55c-e36f-4c45-be83-62ef79342d52',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.003625] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.003975] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.004162] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.004678] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.004678] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.004872] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 is going to be updated. [ 1246.032281] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.032493] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.032493] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.032741] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.032871] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.041742] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: IN_PROGRESS for 2s [ 1246.375519] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6b8aa55c-e36f-4c45-be83-62ef79342d52: rpc.has_security_group_logging(os_id): False [ 1246.391949] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.392108] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.392153] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.392495] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.392625] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.392828] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.392937] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.393012] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.393190] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.393275] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.393472] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.393574] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.393637] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.393783] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.393859] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.394061] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.394157] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.394217] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.394408] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.394495] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.394585] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b8aa55c-e36f-4c45-be83-62ef79342d52 is going to be created. [ 1246.447158] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.447313] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.447357] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.447560] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.447729] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.460820] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b8aa55c-e36f-4c45-be83-62ef79342d52 in Status: IN_PROGRESS for 2s [ 1247.510807] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7acb0b1-c9e7-4016-8d0b-c700463d32e1 in Status: SUCCESS [ 1247.511191] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7acb0b1-c9e7-4016-8d0b-c700463d32e1 deletion is rescheduled due to dependency. [ 1247.511191] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.051947] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: SUCCESS [ 1248.051947] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.471811] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b8aa55c-e36f-4c45-be83-62ef79342d52 in Status: SUCCESS [ 1248.472058] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b8aa55c-e36f-4c45-be83-62ef79342d52" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.008938] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1250.009390] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1252.713160] env[68328]: INFO networking_nsxv3.common.synchronization [req-0def8d7a-fcc2-4eec-92a2-e9aab34b7787 req-5999ce49-c343-40e7-abd5-d7a40b80b656 tempest-ServerPasswordTestJSON-867773349 tempest-ServerPasswordTestJSON-867773349-project-member] Enqueued Resource ID: 6b8aa55c-e36f-4c45-be83-62ef79342d52 with Priority: HIGHEST for action security_group_members [ 1252.713735] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b8aa55c-e36f-4c45-be83-62ef79342d52 with Priority: HIGHEST for action security_group_members [ 1252.714090] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b8aa55c-e36f-4c45-be83-62ef79342d52 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.714236] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b8aa55c-e36f-4c45-be83-62ef79342d52" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.714317] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b8aa55c-e36f-4c45-be83-62ef79342d52" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.714594] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b8aa55c-e36f-4c45-be83-62ef79342d52" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.714703] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.714835] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.714931] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.715109] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.715217] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.715320] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b8aa55c-e36f-4c45-be83-62ef79342d52',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.220027] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.220231] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.220231] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.220420] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.220532] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.220827] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.220943] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.221014] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.221189] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.221268] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.221354] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b8aa55c-e36f-4c45-be83-62ef79342d52 is going to be updated. [ 1253.251474] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.251615] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.251702] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.251946] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.252149] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.260141] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b8aa55c-e36f-4c45-be83-62ef79342d52 in Status: IN_PROGRESS for 2s [ 1254.940612] env[68328]: INFO networking_nsxv3.common.synchronization [req-87f01515-f548-43b9-b991-7bbca7adcd2d req-382d7e01-27c4-4f51-88c9-995e18dcb83b tempest-ServerActionsTestJSON-719988657 tempest-ServerActionsTestJSON-719988657-project-member] Enqueued Resource ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 with Priority: HIGHEST for action security_group_members [ 1254.940612] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 with Priority: HIGHEST for action security_group_members [ 1254.940612] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.940612] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.940612] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.940612] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.940612] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.940612] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.940612] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.940612] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.940612] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.940612] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8024e0cc-9eaa-4282-b00c-9e9b1de030e2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.272777] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b8aa55c-e36f-4c45-be83-62ef79342d52 in Status: SUCCESS [ 1255.272777] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b8aa55c-e36f-4c45-be83-62ef79342d52 deletion is rescheduled due to dependency. [ 1255.272777] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b8aa55c-e36f-4c45-be83-62ef79342d52" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.442999] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.443249] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.443322] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.443545] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.443665] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.443869] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.444012] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.444012] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.444212] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.444294] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.444380] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 is going to be updated. [ 1255.470533] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.470752] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.470917] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.471391] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.471549] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.480219] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 in Status: IN_PROGRESS for 2s [ 1256.241230] env[68328]: INFO networking_nsxv3.common.synchronization [req-98cb8da5-ce88-4060-8aee-e2f75a9159ef req-1db46126-b14e-4991-9da8-a575c3128a70 tempest-ServersTestJSON-1771388484 tempest-ServersTestJSON-1771388484-project-member] Enqueued Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_members [ 1256.241230] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGHEST for action security_group_members [ 1256.241753] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-5841566c-1d05-4389-b8a7-950b5f9c6708 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.241753] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.241753] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.241753] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.241904] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.242090] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.242090] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.242195] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.242297] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.242438] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.745026] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.745226] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.745283] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.745509] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.745603] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.745808] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.745894] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.745989] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.746123] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.746202] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.746291] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 is going to be updated. [ 1256.788248] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.788438] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.788438] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.788640] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.788777] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.799543] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: IN_PROGRESS for 2s [ 1257.491069] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 in Status: SUCCESS [ 1257.491069] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 deletion is rescheduled due to dependency. [ 1257.491069] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.809271] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 in Status: SUCCESS [ 1258.809554] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 deletion is rescheduled due to dependency. [ 1258.809554] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.242629] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1261.242629] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1266.243776] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1266.244084] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1266.396408] env[68328]: INFO networking_nsxv3.common.synchronization [req-db48d60b-77fb-4682-8277-2e5cb72070be req-8166d73d-f04a-4980-a8ba-b2ac495d6a56 tempest-ServerActionsTestJSON-719988657 tempest-ServerActionsTestJSON-719988657-project-member] Enqueued Resource ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 with Priority: HIGHEST for action security_group_members [ 1266.398038] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 with Priority: HIGHEST for action security_group_members [ 1266.398038] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.398038] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.398038] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.398038] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.398531] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.398762] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.398923] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.399175] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.399362] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.399540] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8024e0cc-9eaa-4282-b00c-9e9b1de030e2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.679018] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-74 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.679018] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-74" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.679018] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-74" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.679613] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-74" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.680398] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.680737] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.681631] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.681631] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.681631] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.681631] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1266.681939] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1266.681939] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1266.682028] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1266.682067] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1266.682270] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1266.682330] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1266.703271] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1266.703490] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1266.703718] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1266.703965] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-74" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.704405] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-097c6528-6aa3-4d85-855d-6fc2466ca188 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.704631] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-097c6528-6aa3-4d85-855d-6fc2466ca188" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.704771] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-097c6528-6aa3-4d85-855d-6fc2466ca188" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.705100] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-097c6528-6aa3-4d85-855d-6fc2466ca188" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.705285] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('097c6528-6aa3-4d85-855d-6fc2466ca188',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.904181] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.904181] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.904181] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.904491] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.904491] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.904613] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.904838] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.904838] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.904902] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.904966] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.905072] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 is going to be updated. [ 1266.950576] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.950742] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.950788] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.950978] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.951192] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.962707] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 in Status: IN_PROGRESS for 2s [ 1267.208263] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.208411] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.208882] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.208967] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.209235] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.209910] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 097c6528-6aa3-4d85-855d-6fc2466ca188 not found, creating... [ 1267.209910] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.209910] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.210107] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.210346] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.210525] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.210858] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.211078] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.211605] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.211605] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.211605] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.211789] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 097c6528-6aa3-4d85-855d-6fc2466ca188 is going to be created. [ 1267.231101] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.231330] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.231459] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.231764] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.232036] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.232271] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-097c6528-6aa3-4d85-855d-6fc2466ca188" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.943481] env[68328]: INFO networking_nsxv3.common.synchronization [req-db48d60b-77fb-4682-8277-2e5cb72070be req-564c0469-ee12-4047-a888-a2135a32ddda service nova] Enqueued Resource ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 with Priority: HIGHEST for action security_group_rules [ 1267.943481] env[68328]: INFO networking_nsxv3.common.synchronization [req-db48d60b-77fb-4682-8277-2e5cb72070be req-564c0469-ee12-4047-a888-a2135a32ddda service nova] Enqueued Resource ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 with Priority: HIGHEST for action security_group_members [ 1267.943481] env[68328]: INFO networking_nsxv3.common.synchronization [req-db48d60b-77fb-4682-8277-2e5cb72070be req-564c0469-ee12-4047-a888-a2135a32ddda service nova] Enqueued Resource ID: 097c6528-6aa3-4d85-855d-6fc2466ca188 with Priority: HIGHEST for action port [ 1267.943481] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 with Priority: HIGHEST for action security_group_rules [ 1267.943481] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 with Priority: HIGHEST for action security_group_members [ 1267.943481] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 097c6528-6aa3-4d85-855d-6fc2466ca188 with Priority: HIGHEST for action port [ 1267.943481] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8024e0cc-9eaa-4282-b00c-9e9b1de030e2 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.943481] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.943481] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.943481] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.943481] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8024e0cc-9eaa-4282-b00c-9e9b1de030e2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.945686] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.945686] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.945686] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-097c6528-6aa3-4d85-855d-6fc2466ca188 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.945686] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-097c6528-6aa3-4d85-855d-6fc2466ca188" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.945686] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-097c6528-6aa3-4d85-855d-6fc2466ca188" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.945686] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-097c6528-6aa3-4d85-855d-6fc2466ca188" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.945686] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('097c6528-6aa3-4d85-855d-6fc2466ca188',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.445279] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.445279] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.452024] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 097c6528-6aa3-4d85-855d-6fc2466ca188 with status ACTIVE [ 1268.452129] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.452211] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.452270] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.452488] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.452980] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.452980] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.452980] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.452980] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.453262] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.453262] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.453438] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.453438] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.453515] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.453691] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.453691] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.453883] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 097c6528-6aa3-4d85-855d-6fc2466ca188 is going to be updated. [ 1268.473708] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.473885] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.473948] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.474128] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.474263] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.474433] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-097c6528-6aa3-4d85-855d-6fc2466ca188" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.617956] env[68328]: INFO networking_nsxv3.common.synchronization [req-8584a56c-b171-40e5-8995-e9fd47b00c21 req-ea71a7b4-df12-4693-911e-e821ef42b7f3 tempest-ServerActionsTestOtherA-501294167 tempest-ServerActionsTestOtherA-501294167-project-member] Enqueued Resource ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 with Priority: HIGHEST for action security_group_members [ 1268.620250] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 with Priority: HIGHEST for action security_group_members [ 1268.623373] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-35b651ef-47c8-4ff2-b472-9849f375b8c9 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.623373] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.623373] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.623373] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.623373] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.623373] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.623373] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.623373] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.623373] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.623373] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35b651ef-47c8-4ff2-b472-9849f375b8c9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.954431] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-113 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.954834] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-113" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.954834] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-113" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.955145] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-113" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.955426] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.955621] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.955777] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.956015] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.956697] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.956946] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1268.957088] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1268.957209] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1268.957328] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1268.957451] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1268.957565] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1268.957703] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1268.971537] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 in Status: SUCCESS [ 1268.971697] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 deletion is rescheduled due to dependency. [ 1268.971817] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.971963] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.972174] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.972349] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.972457] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.972586] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.972695] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.972779] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.972872] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8024e0cc-9eaa-4282-b00c-9e9b1de030e2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.977441] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1268.977606] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1268.977776] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1268.977961] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-113" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.978282] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-cf2a23e5-e7ca-490b-a4fd-aad11b103d44 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.978453] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-cf2a23e5-e7ca-490b-a4fd-aad11b103d44" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.978576] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-cf2a23e5-e7ca-490b-a4fd-aad11b103d44" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.978982] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-cf2a23e5-e7ca-490b-a4fd-aad11b103d44" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.979116] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf2a23e5-e7ca-490b-a4fd-aad11b103d44',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.124470] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('35b651ef-47c8-4ff2-b472-9849f375b8c9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.474475] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8024e0cc-9eaa-4282-b00c-9e9b1de030e2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.481269] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.481450] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.481590] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.481872] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.482048] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.482209] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port cf2a23e5-e7ca-490b-a4fd-aad11b103d44 not found, creating... [ 1269.482491] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.482663] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.482787] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.483040] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.483176] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.483463] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.483623] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.483744] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.483954] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.484473] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.484732] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: cf2a23e5-e7ca-490b-a4fd-aad11b103d44 is going to be created. [ 1269.504407] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.504794] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.504975] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.505332] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.505752] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.506043] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-cf2a23e5-e7ca-490b-a4fd-aad11b103d44" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.626492] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('35b651ef-47c8-4ff2-b472-9849f375b8c9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.976661] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8024e0cc-9eaa-4282-b00c-9e9b1de030e2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.129612] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.129874] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.129941] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.130163] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.130274] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.130818] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 is going to be updated. [ 1270.162453] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.162687] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.162742] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.163083] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.163159] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.171873] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 in Status: IN_PROGRESS for 2s [ 1270.203789] env[68328]: INFO networking_nsxv3.common.synchronization [req-8584a56c-b171-40e5-8995-e9fd47b00c21 req-a8c7b8b0-9868-4832-b352-ac1e9469e114 service nova] Enqueued Resource ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 with Priority: HIGHEST for action security_group_rules [ 1270.204083] env[68328]: INFO networking_nsxv3.common.synchronization [req-8584a56c-b171-40e5-8995-e9fd47b00c21 req-a8c7b8b0-9868-4832-b352-ac1e9469e114 service nova] Enqueued Resource ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 with Priority: HIGHEST for action security_group_members [ 1270.204343] env[68328]: INFO networking_nsxv3.common.synchronization [req-8584a56c-b171-40e5-8995-e9fd47b00c21 req-a8c7b8b0-9868-4832-b352-ac1e9469e114 service nova] Enqueued Resource ID: cf2a23e5-e7ca-490b-a4fd-aad11b103d44 with Priority: HIGHEST for action port [ 1270.205215] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 with Priority: HIGHEST for action security_group_rules [ 1270.205409] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 with Priority: HIGHEST for action security_group_members [ 1270.205563] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf2a23e5-e7ca-490b-a4fd-aad11b103d44 with Priority: HIGHEST for action port [ 1270.206020] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-35b651ef-47c8-4ff2-b472-9849f375b8c9 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.206215] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.206313] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.206602] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.206705] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('35b651ef-47c8-4ff2-b472-9849f375b8c9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.207734] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-35b651ef-47c8-4ff2-b472-9849f375b8c9 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.207867] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.208138] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf2a23e5-e7ca-490b-a4fd-aad11b103d44 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.208301] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf2a23e5-e7ca-490b-a4fd-aad11b103d44" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.208419] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf2a23e5-e7ca-490b-a4fd-aad11b103d44" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.208660] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf2a23e5-e7ca-490b-a4fd-aad11b103d44" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.208793] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf2a23e5-e7ca-490b-a4fd-aad11b103d44',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.479273] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.479478] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.479520] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.479717] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.479813] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.479918] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 is going to be updated. [ 1270.507836] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.507988] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.508089] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.508370] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.508520] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.519083] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 in Status: IN_PROGRESS for 2s [ 1270.710990] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-35b651ef-47c8-4ff2-b472-9849f375b8c9 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.711172] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.712518] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cf2a23e5-e7ca-490b-a4fd-aad11b103d44 with status ACTIVE [ 1270.712815] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.712941] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.713011] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.713278] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.713446] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.713580] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.713741] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.713774] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.713980] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.714744] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.714744] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.714744] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.714744] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.714744] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.715040] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.715040] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cf2a23e5-e7ca-490b-a4fd-aad11b103d44 is going to be updated. [ 1270.735993] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.736151] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.736219] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.736437] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.736566] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.736725] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf2a23e5-e7ca-490b-a4fd-aad11b103d44" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.168245] env[68328]: INFO networking_nsxv3.common.synchronization [req-4a054a2a-4834-49c7-ac02-de71bf3988bb req-ca94bec5-a4be-4686-9006-2e55f3662e48 tempest-ServerActionsTestOtherB-24837534 tempest-ServerActionsTestOtherB-24837534-project-member] Enqueued Resource ID: 54390b69-5280-4540-a63f-fa4daae4a11f with Priority: HIGHEST for action security_group_members [ 1272.168245] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54390b69-5280-4540-a63f-fa4daae4a11f with Priority: HIGHEST for action security_group_members [ 1272.168565] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-54390b69-5280-4540-a63f-fa4daae4a11f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.168626] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.169653] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.169653] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.169653] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.169653] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.169653] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.170125] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.170125] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.170125] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54390b69-5280-4540-a63f-fa4daae4a11f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.184422] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 in Status: SUCCESS [ 1272.184422] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.184422] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.184422] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.184422] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.184422] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.184422] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.184422] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.184422] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.184422] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35b651ef-47c8-4ff2-b472-9849f375b8c9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.530147] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 in Status: SUCCESS [ 1272.530786] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.533185] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.533185] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.533185] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.533185] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.533185] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.533185] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.533185] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.533185] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.533185] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8024e0cc-9eaa-4282-b00c-9e9b1de030e2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.674441] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.674441] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.674441] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.674441] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.674441] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.674441] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.674441] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.674441] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.674441] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.674441] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.674441] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54390b69-5280-4540-a63f-fa4daae4a11f is going to be updated. [ 1272.686867] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('35b651ef-47c8-4ff2-b472-9849f375b8c9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.703367] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.703529] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.703577] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.703775] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.703912] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.712395] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54390b69-5280-4540-a63f-fa4daae4a11f in Status: IN_PROGRESS for 2s [ 1273.037642] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8024e0cc-9eaa-4282-b00c-9e9b1de030e2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.189513] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('35b651ef-47c8-4ff2-b472-9849f375b8c9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.540572] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8024e0cc-9eaa-4282-b00c-9e9b1de030e2: rpc.has_security_group_logging(os_id): False [ 1273.558821] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.558977] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.559056] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.559261] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.559353] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.559602] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.559701] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.559790] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.559962] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.560056] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.560145] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 is going to be updated. [ 1273.614224] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.614411] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.614494] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.614784] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.614945] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.629635] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 in Status: IN_PROGRESS for 2s [ 1273.691422] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.691635] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.691719] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.691948] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.692053] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.692156] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 is going to be updated. [ 1273.719540] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.719724] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.719796] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.719977] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.720139] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.728120] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 in Status: IN_PROGRESS for 2s [ 1274.722028] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54390b69-5280-4540-a63f-fa4daae4a11f in Status: SUCCESS [ 1274.722344] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54390b69-5280-4540-a63f-fa4daae4a11f deletion is rescheduled due to dependency. [ 1274.722344] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.642350] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 in Status: SUCCESS [ 1275.642616] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.738802] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 in Status: SUCCESS [ 1275.739165] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.739456] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.739909] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.740188] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.740387] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.740547] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.740972] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.741068] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.741350] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.741543] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('35b651ef-47c8-4ff2-b472-9849f375b8c9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.247430] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('35b651ef-47c8-4ff2-b472-9849f375b8c9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.750078] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 35b651ef-47c8-4ff2-b472-9849f375b8c9: rpc.has_security_group_logging(os_id): False [ 1276.771585] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.771818] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.771914] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.772234] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.772382] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.772684] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.772793] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.772880] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.773079] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.773169] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.773265] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 is going to be updated. [ 1276.852280] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.852499] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.852588] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.853080] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.853080] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.866670] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 in Status: IN_PROGRESS for 2s [ 1277.168910] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1277.169042] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1278.897415] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 in Status: SUCCESS [ 1278.897415] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.169938] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1282.170404] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1283.317272] env[68328]: INFO networking_nsxv3.common.synchronization [req-f24964f1-c9eb-445d-bc52-47e452e11c1e req-ff8733d2-bcab-43b5-b2b5-32a87ee91259 tempest-ServerActionsTestOtherB-24837534 tempest-ServerActionsTestOtherB-24837534-project-member] Enqueued Resource ID: 54390b69-5280-4540-a63f-fa4daae4a11f with Priority: HIGHEST for action security_group_members [ 1283.317876] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54390b69-5280-4540-a63f-fa4daae4a11f with Priority: HIGHEST for action security_group_members [ 1283.318319] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-54390b69-5280-4540-a63f-fa4daae4a11f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.318470] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.318562] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.318785] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.318995] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.319244] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.319244] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.319418] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.319537] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.319683] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54390b69-5280-4540-a63f-fa4daae4a11f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.597403] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-507 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.597403] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-507" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.597403] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-507" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.597403] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-507" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.597403] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.597403] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.597764] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.597764] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.597840] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.598099] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1283.598224] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1283.598346] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1283.598480] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1283.598603] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1283.598715] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1283.598861] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1283.618827] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1283.619047] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1283.619205] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1283.619385] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-507" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.619737] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-3c2f2ce6-bca9-4b56-9f36-0c3e93ee3321 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.619916] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-3c2f2ce6-bca9-4b56-9f36-0c3e93ee3321" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.620064] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-3c2f2ce6-bca9-4b56-9f36-0c3e93ee3321" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.620413] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-3c2f2ce6-bca9-4b56-9f36-0c3e93ee3321" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.620561] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c2f2ce6-bca9-4b56-9f36-0c3e93ee3321',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.824511] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.824678] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.824855] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.825043] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.825149] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.825354] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.825455] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.825512] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.825662] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.825776] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.825875] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54390b69-5280-4540-a63f-fa4daae4a11f is going to be updated. [ 1283.853063] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.853247] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.853305] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.853502] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.853642] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.863907] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54390b69-5280-4540-a63f-fa4daae4a11f in Status: IN_PROGRESS for 2s [ 1284.123081] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.123363] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.123442] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.123717] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.123953] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.124167] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 3c2f2ce6-bca9-4b56-9f36-0c3e93ee3321 not found, creating... [ 1284.124464] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.124627] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.124774] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.125013] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.125170] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.125889] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.126120] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.126258] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.126482] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.126639] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.126867] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 3c2f2ce6-bca9-4b56-9f36-0c3e93ee3321 is going to be created. [ 1284.151424] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.151669] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.151787] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.152060] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.152302] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.152541] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-3c2f2ce6-bca9-4b56-9f36-0c3e93ee3321" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.842897] env[68328]: INFO networking_nsxv3.common.synchronization [req-f24964f1-c9eb-445d-bc52-47e452e11c1e req-ef8cf95d-26dc-4da9-8e37-e8f628565c3f service nova] Enqueued Resource ID: 54390b69-5280-4540-a63f-fa4daae4a11f with Priority: HIGHEST for action security_group_rules [ 1284.843185] env[68328]: INFO networking_nsxv3.common.synchronization [req-f24964f1-c9eb-445d-bc52-47e452e11c1e req-ef8cf95d-26dc-4da9-8e37-e8f628565c3f service nova] Enqueued Resource ID: 54390b69-5280-4540-a63f-fa4daae4a11f with Priority: HIGHEST for action security_group_members [ 1284.843261] env[68328]: INFO networking_nsxv3.common.synchronization [req-f24964f1-c9eb-445d-bc52-47e452e11c1e req-ef8cf95d-26dc-4da9-8e37-e8f628565c3f service nova] Enqueued Resource ID: 3c2f2ce6-bca9-4b56-9f36-0c3e93ee3321 with Priority: HIGHEST for action port [ 1284.843562] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54390b69-5280-4540-a63f-fa4daae4a11f with Priority: HIGHEST for action security_group_rules [ 1284.843682] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54390b69-5280-4540-a63f-fa4daae4a11f with Priority: HIGHEST for action security_group_members [ 1284.843780] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c2f2ce6-bca9-4b56-9f36-0c3e93ee3321 with Priority: HIGHEST for action port [ 1284.844403] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54390b69-5280-4540-a63f-fa4daae4a11f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.844480] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.844548] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.844795] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.844881] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54390b69-5280-4540-a63f-fa4daae4a11f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.845724] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-54390b69-5280-4540-a63f-fa4daae4a11f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.845956] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.846207] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c2f2ce6-bca9-4b56-9f36-0c3e93ee3321 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.846330] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c2f2ce6-bca9-4b56-9f36-0c3e93ee3321" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.846408] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c2f2ce6-bca9-4b56-9f36-0c3e93ee3321" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.846535] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c2f2ce6-bca9-4b56-9f36-0c3e93ee3321" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.846614] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c2f2ce6-bca9-4b56-9f36-0c3e93ee3321',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.348048] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-54390b69-5280-4540-a63f-fa4daae4a11f taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.348191] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.350763] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3c2f2ce6-bca9-4b56-9f36-0c3e93ee3321 with status ACTIVE [ 1285.350980] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.351139] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.351225] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.351474] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.351567] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.351775] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.351875] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.351949] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.352996] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.353119] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.353323] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.353495] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.353544] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.353686] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.353773] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.353865] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3c2f2ce6-bca9-4b56-9f36-0c3e93ee3321 is going to be updated. [ 1285.400442] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.400663] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.400762] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.401030] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.401240] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.401413] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c2f2ce6-bca9-4b56-9f36-0c3e93ee3321" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.874744] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54390b69-5280-4540-a63f-fa4daae4a11f in Status: SUCCESS [ 1285.874744] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54390b69-5280-4540-a63f-fa4daae4a11f deletion is rescheduled due to dependency. [ 1285.874744] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.874744] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.875483] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.875483] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.875483] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.875483] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.875770] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.875770] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.875770] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54390b69-5280-4540-a63f-fa4daae4a11f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.377849] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('54390b69-5280-4540-a63f-fa4daae4a11f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.879983] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('54390b69-5280-4540-a63f-fa4daae4a11f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.382534] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.382743] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.382743] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.383015] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.383122] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.383226] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54390b69-5280-4540-a63f-fa4daae4a11f is going to be updated. [ 1287.409861] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.409952] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.409995] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.410235] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.410373] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.417705] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54390b69-5280-4540-a63f-fa4daae4a11f in Status: IN_PROGRESS for 2s [ 1289.429279] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54390b69-5280-4540-a63f-fa4daae4a11f in Status: SUCCESS [ 1289.429639] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.429727] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.430040] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.430338] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.430528] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.430643] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.430821] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.430947] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.431062] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.431157] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('54390b69-5280-4540-a63f-fa4daae4a11f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.844553] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1289.844654] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1289.933503] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('54390b69-5280-4540-a63f-fa4daae4a11f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.436280] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 54390b69-5280-4540-a63f-fa4daae4a11f: rpc.has_security_group_logging(os_id): False [ 1290.453854] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.454078] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.454078] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.454353] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.454482] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.454755] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.454922] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.454987] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.455162] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.455259] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.455347] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54390b69-5280-4540-a63f-fa4daae4a11f is going to be updated. [ 1290.540061] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.540286] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.540369] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.540613] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.540800] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.553855] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54390b69-5280-4540-a63f-fa4daae4a11f in Status: IN_PROGRESS for 2s [ 1292.568974] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54390b69-5280-4540-a63f-fa4daae4a11f in Status: SUCCESS [ 1292.568974] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.846076] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1294.846336] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1296.384228] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-194 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.384551] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-194" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.384551] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-194" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.384799] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-194" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.385099] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.385268] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.385388] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.385614] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.385762] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.385991] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1296.386121] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1296.386232] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1296.386344] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1296.386457] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1296.386566] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1296.386700] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1296.406451] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1296.406625] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1296.406769] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1296.406947] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-194" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.407318] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-774af91e-05b5-47ed-a1b2-a75901be965f taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.407509] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-774af91e-05b5-47ed-a1b2-a75901be965f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.407638] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-774af91e-05b5-47ed-a1b2-a75901be965f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.407902] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-774af91e-05b5-47ed-a1b2-a75901be965f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.408057] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('774af91e-05b5-47ed-a1b2-a75901be965f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.910542] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.910847] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.910947] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.911314] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.911358] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.911637] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.911802] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.911932] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.912204] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.912798] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.912798] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.912798] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.913062] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.913332] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.913515] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.913627] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 774af91e-05b5-47ed-a1b2-a75901be965f is going to be updated. [ 1296.937078] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.937317] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.937452] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.937876] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.938101] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.938339] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-774af91e-05b5-47ed-a1b2-a75901be965f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.600928] env[68328]: INFO networking_nsxv3.common.synchronization [req-040ad576-6087-4a6a-9d14-5e21caed3a89 req-b8a38935-a978-48bd-a4d9-ab7e2ee95234 service nova] Enqueued Resource ID: b1c2fa85-ca03-4043-a12f-6ed71cf5c151 with Priority: HIGHEST for action security_group_rules [ 1297.601235] env[68328]: INFO networking_nsxv3.common.synchronization [req-040ad576-6087-4a6a-9d14-5e21caed3a89 req-b8a38935-a978-48bd-a4d9-ab7e2ee95234 service nova] Enqueued Resource ID: b1c2fa85-ca03-4043-a12f-6ed71cf5c151 with Priority: HIGHEST for action security_group_members [ 1297.601313] env[68328]: INFO networking_nsxv3.common.synchronization [req-040ad576-6087-4a6a-9d14-5e21caed3a89 req-b8a38935-a978-48bd-a4d9-ab7e2ee95234 service nova] Enqueued Resource ID: 774af91e-05b5-47ed-a1b2-a75901be965f with Priority: HIGHEST for action port [ 1297.601543] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1c2fa85-ca03-4043-a12f-6ed71cf5c151 with Priority: HIGHEST for action security_group_rules [ 1297.601673] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1c2fa85-ca03-4043-a12f-6ed71cf5c151 with Priority: HIGHEST for action security_group_members [ 1297.601769] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 774af91e-05b5-47ed-a1b2-a75901be965f with Priority: HIGHEST for action port [ 1297.602326] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1c2fa85-ca03-4043-a12f-6ed71cf5c151 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.602446] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1c2fa85-ca03-4043-a12f-6ed71cf5c151" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.602513] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1c2fa85-ca03-4043-a12f-6ed71cf5c151" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.602710] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1c2fa85-ca03-4043-a12f-6ed71cf5c151" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.602803] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1c2fa85-ca03-4043-a12f-6ed71cf5c151',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.603765] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1c2fa85-ca03-4043-a12f-6ed71cf5c151 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.603873] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1c2fa85-ca03-4043-a12f-6ed71cf5c151" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.603945] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1c2fa85-ca03-4043-a12f-6ed71cf5c151" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.604139] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1c2fa85-ca03-4043-a12f-6ed71cf5c151" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.604323] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.604460] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.604518] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.604617] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.604693] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.604812] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1c2fa85-ca03-4043-a12f-6ed71cf5c151',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.605575] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-774af91e-05b5-47ed-a1b2-a75901be965f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.605704] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-774af91e-05b5-47ed-a1b2-a75901be965f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.605762] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-774af91e-05b5-47ed-a1b2-a75901be965f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.606057] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-774af91e-05b5-47ed-a1b2-a75901be965f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.606057] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('774af91e-05b5-47ed-a1b2-a75901be965f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.108037] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b1c2fa85-ca03-4043-a12f-6ed71cf5c151',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.109093] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1c2fa85-ca03-4043-a12f-6ed71cf5c151 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.109241] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1c2fa85-ca03-4043-a12f-6ed71cf5c151" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.110627] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 774af91e-05b5-47ed-a1b2-a75901be965f with status ACTIVE [ 1298.110798] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.110984] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.110984] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.111186] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.111276] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.111438] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.111532] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.111588] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.111736] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.111810] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.111985] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.112094] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.112152] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.112289] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.112360] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.112442] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 774af91e-05b5-47ed-a1b2-a75901be965f is going to be updated. [ 1298.132215] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.132356] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.132398] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.132611] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.132753] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.132971] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-774af91e-05b5-47ed-a1b2-a75901be965f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.610738] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b1c2fa85-ca03-4043-a12f-6ed71cf5c151',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.114272] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.114588] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.114588] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.115157] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.115157] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.115157] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1c2fa85-ca03-4043-a12f-6ed71cf5c151 is going to be updated. [ 1299.142064] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.142225] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.142295] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.142513] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.142654] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.152016] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1c2fa85-ca03-4043-a12f-6ed71cf5c151 in Status: IN_PROGRESS for 2s [ 1301.166019] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1c2fa85-ca03-4043-a12f-6ed71cf5c151 in Status: SUCCESS [ 1301.166757] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1c2fa85-ca03-4043-a12f-6ed71cf5c151" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.166757] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1c2fa85-ca03-4043-a12f-6ed71cf5c151" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.166947] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1c2fa85-ca03-4043-a12f-6ed71cf5c151" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.167201] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.167464] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.167464] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.167732] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.167922] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.168048] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1c2fa85-ca03-4043-a12f-6ed71cf5c151" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.169134] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b1c2fa85-ca03-4043-a12f-6ed71cf5c151',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.671195] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b1c2fa85-ca03-4043-a12f-6ed71cf5c151',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.173991] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b1c2fa85-ca03-4043-a12f-6ed71cf5c151: rpc.has_security_group_logging(os_id): False [ 1302.191839] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.192123] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.192123] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.192337] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.192503] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.192777] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.192880] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.192953] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.193121] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.193198] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.193285] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1c2fa85-ca03-4043-a12f-6ed71cf5c151 is going to be updated. [ 1302.255928] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.256253] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.256253] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.256417] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.256701] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.272613] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1c2fa85-ca03-4043-a12f-6ed71cf5c151 in Status: IN_PROGRESS for 2s [ 1302.602894] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1302.603170] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1304.288366] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1c2fa85-ca03-4043-a12f-6ed71cf5c151 in Status: SUCCESS [ 1304.288366] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1c2fa85-ca03-4043-a12f-6ed71cf5c151" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.604793] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1307.604793] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1312.605885] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1312.606236] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1315.310243] env[68328]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-038e1d26-3718-4954-be87-7b533345599d None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1315.310657] env[68328]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-038e1d26-3718-4954-be87-7b533345599d None None] NSXv3 Agent Agent loop - iteration:3 started [ 1317.606705] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1317.607056] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1321.271046] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.271046] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.271046] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.271046] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.271637] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1321.774390] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.277240] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.607804] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1322.607973] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1322.779723] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1322.779943] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1323.486654] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.487059] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.487059] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.487271] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.507965] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1323.509335] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.510662] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1323.557413] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.557597] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.557695] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.557967] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.582095] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.583337] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1323.584193] env[68328]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=68328) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1323.584325] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1323.622469] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.622616] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.622664] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.622850] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.624108] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.624275] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1323.690917] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.691097] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.691150] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.691325] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.691605] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.691846] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1323.763744] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.763902] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.763948] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.764116] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.764362] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.764596] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:45. [ 1323.764689] env[68328]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'d7acb0b1-c9e7-4016-8d0b-c700463d32e1', 'e50e8525-9eb2-4aff-9a46-c4c1621d14db', 'fef607f8-3758-4e8a-87f1-a5984690df6e', '378c3841-8f36-4e7a-8646-033f27e348d9', 'e27762cf-c0f5-443d-8332-584b8241d0be', 'f0bcdd73-03e5-43ee-a623-9ac2490cee8f', '398e93bc-b7ea-4684-aa02-2e6ab22c1fe5', '35b651ef-47c8-4ff2-b472-9849f375b8c9', '9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a', '4bbd48a8-069c-43ef-b15c-47d19b8c7798', 'd160efa7-0312-433f-b94f-cf7e99e24473', '5841566c-1d05-4389-b8a7-950b5f9c6708', 'b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2', '59e1c3b9-919d-40eb-abaa-23f4746bb660', 'b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed', '57b7bbe5-8e54-4d67-b8c6-8cfc418f7042', '64f74f98-269e-44e8-8235-fe4f7a472b01', 'f0811b65-cde4-4246-a2e0-5bbd90921f5b', '261361c9-81c8-47fa-9a8a-4e37a8a439d7', 'c897dadb-95bc-4de7-a117-d38870fbace8', '3b0dcde5-1c71-45fa-b1b1-331b2ba39902', 'b3fc1540-17fb-42c4-99d2-880ae35db079', '4a187ea6-2982-413a-85b8-d76179583bdb', '6b8aa55c-e36f-4c45-be83-62ef79342d52', '8024e0cc-9eaa-4282-b00c-9e9b1de030e2', '3826a056-9a94-48ea-97d8-49b840d3fb63', 'b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724', '70738fbe-b41d-467c-86c7-92a8c5a2a723', '078ed1cc-5f72-48f4-8e16-b1d53057c32e', '72ca69cd-fcd9-4815-b331-9858d9cfad42', '6e39d3b8-c430-4219-9295-992b699ce546', '7c35aa45-69e7-4952-b5d8-8a7d6b3460e1', '551b86cb-6c17-4238-9ac7-89fd77e1e91b', '8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b', 'b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38', '1b5440d1-45ae-41d0-a9b6-24cc237ec6a2', 'ce9938d1-497b-4835-b26f-069491d36e2e', '55dff300-131a-42f9-920d-f2b5a3b91449', 'fdf99f09-b7da-4a5c-af72-042c6f58dc8e', '4607d7c6-d635-4a5a-9767-6150fed7c420', '54390b69-5280-4540-a63f-fa4daae4a11f', 'b1c2fa85-ca03-4043-a12f-6ed71cf5c151', '7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63', '136bcfc4-bc92-46ea-9e01-01b9a11704ee', '57513254-a6e5-4b1e-87b8-b529d35f4b6b'} {{(pid=68328) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1323.764793] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1323.781826] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.781947] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.781991] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.782162] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.782241] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.782335] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1323.782405] env[68328]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=68328) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1323.782472] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1323.848219] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.848381] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.848381] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.848530] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.849582] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.849811] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1323.849890] env[68328]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=68328) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1323.849962] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1323.850040] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1323.850121] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/45 resources of Type:Security Group Rules [ 1323.850194] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d7acb0b1-c9e7-4016-8d0b-c700463d32e1 with Priority: HIGH for action security_group_rules [ 1323.850272] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e50e8525-9eb2-4aff-9a46-c4c1621d14db with Priority: HIGH for action security_group_rules [ 1323.850337] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fef607f8-3758-4e8a-87f1-a5984690df6e with Priority: HIGH for action security_group_rules [ 1323.850400] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 378c3841-8f36-4e7a-8646-033f27e348d9 with Priority: HIGH for action security_group_rules [ 1323.850462] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e27762cf-c0f5-443d-8332-584b8241d0be with Priority: HIGH for action security_group_rules [ 1323.850522] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f with Priority: HIGH for action security_group_rules [ 1323.850586] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 with Priority: HIGH for action security_group_rules [ 1323.850671] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 with Priority: HIGH for action security_group_rules [ 1323.850714] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a with Priority: HIGH for action security_group_rules [ 1323.850752] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 with Priority: HIGH for action security_group_rules [ 1323.850814] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d160efa7-0312-433f-b94f-cf7e99e24473 with Priority: HIGH for action security_group_rules [ 1323.850875] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGH for action security_group_rules [ 1323.850937] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2 with Priority: HIGH for action security_group_rules [ 1323.850998] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 59e1c3b9-919d-40eb-abaa-23f4746bb660 with Priority: HIGH for action security_group_rules [ 1323.851070] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed with Priority: HIGH for action security_group_rules [ 1323.851133] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 57b7bbe5-8e54-4d67-b8c6-8cfc418f7042 with Priority: HIGH for action security_group_rules [ 1323.851193] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 64f74f98-269e-44e8-8235-fe4f7a472b01 with Priority: HIGH for action security_group_rules [ 1323.851252] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f0811b65-cde4-4246-a2e0-5bbd90921f5b with Priority: HIGH for action security_group_rules [ 1323.851314] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 with Priority: HIGH for action security_group_rules [ 1323.851376] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c897dadb-95bc-4de7-a117-d38870fbace8 with Priority: HIGH for action security_group_rules [ 1323.851467] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.609269] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1327.609665] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1327.609665] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7acb0b1-c9e7-4016-8d0b-c700463d32e1 with Priority: HIGH for action security_group_rules [ 1327.609665] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fef607f8-3758-4e8a-87f1-a5984690df6e with Priority: HIGH for action security_group_rules [ 1327.609771] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 with Priority: HIGH for action security_group_rules [ 1327.609805] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed with Priority: HIGH for action security_group_rules [ 1327.609917] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c897dadb-95bc-4de7-a117-d38870fbace8 with Priority: HIGH for action security_group_rules [ 1327.609979] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 with Priority: HIGH for action security_group_rules [ 1327.610070] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0811b65-cde4-4246-a2e0-5bbd90921f5b with Priority: HIGH for action security_group_rules [ 1327.610164] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64f74f98-269e-44e8-8235-fe4f7a472b01 with Priority: HIGH for action security_group_rules [ 1327.610255] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59e1c3b9-919d-40eb-abaa-23f4746bb660 with Priority: HIGH for action security_group_rules [ 1327.610346] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57b7bbe5-8e54-4d67-b8c6-8cfc418f7042 with Priority: HIGH for action security_group_rules [ 1327.610420] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2 with Priority: HIGH for action security_group_rules [ 1327.610508] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 with Priority: HIGH for action security_group_rules [ 1327.610592] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d160efa7-0312-433f-b94f-cf7e99e24473 with Priority: HIGH for action security_group_rules [ 1327.610675] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 with Priority: HIGH for action security_group_rules [ 1327.610759] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a with Priority: HIGH for action security_group_rules [ 1327.610843] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f with Priority: HIGH for action security_group_rules [ 1327.610926] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 with Priority: HIGH for action security_group_rules [ 1327.611020] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e27762cf-c0f5-443d-8332-584b8241d0be with Priority: HIGH for action security_group_rules [ 1327.611109] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e50e8525-9eb2-4aff-9a46-c4c1621d14db with Priority: HIGH for action security_group_rules [ 1327.611193] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 378c3841-8f36-4e7a-8646-033f27e348d9 with Priority: HIGH for action security_group_rules [ 1327.611543] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d7acb0b1-c9e7-4016-8d0b-c700463d32e1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.611670] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.611731] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.611940] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.612034] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d7acb0b1-c9e7-4016-8d0b-c700463d32e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.613028] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fef607f8-3758-4e8a-87f1-a5984690df6e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.613928] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.613928] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.614070] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.614154] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fef607f8-3758-4e8a-87f1-a5984690df6e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.615181] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.615280] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.615342] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.615518] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.615592] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('398e93bc-b7ea-4684-aa02-2e6ab22c1fe5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.616780] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.616780] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.616780] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.616780] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.616780] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.617406] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c897dadb-95bc-4de7-a117-d38870fbace8 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.617516] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c897dadb-95bc-4de7-a117-d38870fbace8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.617573] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c897dadb-95bc-4de7-a117-d38870fbace8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.617761] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c897dadb-95bc-4de7-a117-d38870fbace8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.617817] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c897dadb-95bc-4de7-a117-d38870fbace8',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.618465] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-261361c9-81c8-47fa-9a8a-4e37a8a439d7 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.618573] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.618629] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.618778] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.618882] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('261361c9-81c8-47fa-9a8a-4e37a8a439d7',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.621356] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f0811b65-cde4-4246-a2e0-5bbd90921f5b taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.621463] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f0811b65-cde4-4246-a2e0-5bbd90921f5b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.621525] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f0811b65-cde4-4246-a2e0-5bbd90921f5b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.621678] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f0811b65-cde4-4246-a2e0-5bbd90921f5b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.621748] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f0811b65-cde4-4246-a2e0-5bbd90921f5b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.622419] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64f74f98-269e-44e8-8235-fe4f7a472b01 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.622544] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64f74f98-269e-44e8-8235-fe4f7a472b01" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.622588] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64f74f98-269e-44e8-8235-fe4f7a472b01" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.622757] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64f74f98-269e-44e8-8235-fe4f7a472b01" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.622833] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64f74f98-269e-44e8-8235-fe4f7a472b01',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.623513] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-59e1c3b9-919d-40eb-abaa-23f4746bb660 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.623618] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-59e1c3b9-919d-40eb-abaa-23f4746bb660" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.623681] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-59e1c3b9-919d-40eb-abaa-23f4746bb660" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.623825] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-59e1c3b9-919d-40eb-abaa-23f4746bb660" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.623907] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('59e1c3b9-919d-40eb-abaa-23f4746bb660',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.624553] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57b7bbe5-8e54-4d67-b8c6-8cfc418f7042 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.624653] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57b7bbe5-8e54-4d67-b8c6-8cfc418f7042" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.624716] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57b7bbe5-8e54-4d67-b8c6-8cfc418f7042" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.624862] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57b7bbe5-8e54-4d67-b8c6-8cfc418f7042" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.624935] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57b7bbe5-8e54-4d67-b8c6-8cfc418f7042',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.625700] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.625794] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.625849] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.625988] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.626081] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.626734] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5841566c-1d05-4389-b8a7-950b5f9c6708 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.626813] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.626870] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.627030] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.627097] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5841566c-1d05-4389-b8a7-950b5f9c6708',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.627725] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d160efa7-0312-433f-b94f-cf7e99e24473 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.627831] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.627889] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.628039] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.628112] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d160efa7-0312-433f-b94f-cf7e99e24473',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.628745] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4bbd48a8-069c-43ef-b15c-47d19b8c7798 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.628850] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.628913] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.629068] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.629138] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4bbd48a8-069c-43ef-b15c-47d19b8c7798',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.629856] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.629961] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.630041] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.630181] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.630256] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.630902] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f0bcdd73-03e5-43ee-a623-9ac2490cee8f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.631016] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.631083] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.631228] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.631297] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f0bcdd73-03e5-43ee-a623-9ac2490cee8f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.631928] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-35b651ef-47c8-4ff2-b472-9849f375b8c9 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.632043] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.632104] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.632252] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.632322] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('35b651ef-47c8-4ff2-b472-9849f375b8c9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.633041] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e27762cf-c0f5-443d-8332-584b8241d0be taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.633197] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e27762cf-c0f5-443d-8332-584b8241d0be" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.633236] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e27762cf-c0f5-443d-8332-584b8241d0be" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.633369] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e27762cf-c0f5-443d-8332-584b8241d0be" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.633441] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e27762cf-c0f5-443d-8332-584b8241d0be',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.634600] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e50e8525-9eb2-4aff-9a46-c4c1621d14db taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.634600] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e50e8525-9eb2-4aff-9a46-c4c1621d14db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.634600] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e50e8525-9eb2-4aff-9a46-c4c1621d14db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.634600] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e50e8525-9eb2-4aff-9a46-c4c1621d14db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.634600] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e50e8525-9eb2-4aff-9a46-c4c1621d14db',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.635084] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-378c3841-8f36-4e7a-8646-033f27e348d9 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.635202] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-378c3841-8f36-4e7a-8646-033f27e348d9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.635272] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-378c3841-8f36-4e7a-8646-033f27e348d9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.635455] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-378c3841-8f36-4e7a-8646-033f27e348d9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.635563] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('378c3841-8f36-4e7a-8646-033f27e348d9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.659847] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.659995] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.660056] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.660236] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.664406] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.664514] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.676867] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.676981] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 398e93bc-b7ea-4684-aa02-2e6ab22c1fe5 is going to be deleted. [ 1327.677962] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.678208] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.697694] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.697800] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 59e1c3b9-919d-40eb-abaa-23f4746bb660 is going to be deleted. [ 1327.746097] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.746331] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.746384] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.746555] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.746645] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.746765] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-398e93bc-b7ea-4684-aa02-2e6ab22c1fe5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.747826] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.747928] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.747996] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.748185] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.748266] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.748375] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-59e1c3b9-919d-40eb-abaa-23f4746bb660" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.144163] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-35b651ef-47c8-4ff2-b472-9849f375b8c9 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.144405] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.144525] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.144806] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.145077] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.145268] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.145377] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.145625] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.145776] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.145929] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.146076] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('35b651ef-47c8-4ff2-b472-9849f375b8c9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.213801] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.214072] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.214072] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.214175] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.215791] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.215942] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.216599] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.216702] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.217367] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.217474] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.218417] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.218511] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.219175] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.219290] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.219944] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.220047] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.220742] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.220838] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.221509] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.221603] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.222270] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.222363] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.223013] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.223116] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.223675] env[68328]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1328.224080] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.224175] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.224792] env[68328]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1328.225155] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.225270] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.226105] env[68328]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1328.226505] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.226617] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.227203] env[68328]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1328.227595] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.227707] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.228268] env[68328]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1328.228616] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.228707] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.230773] env[68328]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1328.231129] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.231222] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.233376] env[68328]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1328.233762] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.233869] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0811b65-cde4-4246-a2e0-5bbd90921f5b is going to be deleted. [ 1328.234677] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.234868] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.250441] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.250551] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e27762cf-c0f5-443d-8332-584b8241d0be is going to be deleted. [ 1328.251330] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.251540] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.267299] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.267480] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c897dadb-95bc-4de7-a117-d38870fbace8 is going to be deleted. [ 1328.268166] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.268366] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.286558] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.286700] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4bbd48a8-069c-43ef-b15c-47d19b8c7798 is going to be deleted. [ 1328.287595] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.287809] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.296590] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.296752] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.305435] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.305572] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.308380] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.308495] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 378c3841-8f36-4e7a-8646-033f27e348d9 is going to be deleted. [ 1328.309300] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.309503] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.323803] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.323948] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.326583] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.326696] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fef607f8-3758-4e8a-87f1-a5984690df6e is going to be deleted. [ 1328.327449] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.327666] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.347062] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.347179] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 261361c9-81c8-47fa-9a8a-4e37a8a439d7 is going to be deleted. [ 1328.347937] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.348153] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.351880] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.351989] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.397606] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.397823] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.416552] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.416711] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d7acb0b1-c9e7-4016-8d0b-c700463d32e1 is going to be deleted. [ 1328.417651] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.417896] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.450521] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.450761] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.455427] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.455615] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.457339] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.457469] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2 is going to be deleted. [ 1328.458323] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.458539] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.479751] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.479878] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64f74f98-269e-44e8-8235-fe4f7a472b01 is going to be deleted. [ 1328.480659] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.480865] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.583681] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.583681] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.585218] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.585218] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed is going to be deleted. [ 1328.586032] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.586252] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.593930] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.594067] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.607605] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.607731] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57b7bbe5-8e54-4d67-b8c6-8cfc418f7042 is going to be deleted. [ 1328.608597] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.608802] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.625851] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.625851] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.629169] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.629169] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a is going to be deleted. [ 1328.629268] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.629410] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.653015] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('35b651ef-47c8-4ff2-b472-9849f375b8c9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.654765] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.654991] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d160efa7-0312-433f-b94f-cf7e99e24473 is going to be deleted. [ 1328.655745] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.655954] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.657304] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.657404] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.711746] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.711746] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.714060] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.714060] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5841566c-1d05-4389-b8a7-950b5f9c6708 is going to be deleted. [ 1328.714699] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.714922] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.716233] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.716353] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.784683] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.784859] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0bcdd73-03e5-43ee-a623-9ac2490cee8f is going to be deleted. [ 1328.785834] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.786081] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.799651] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.799651] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.842206] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.842389] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.851064] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.851269] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e50e8525-9eb2-4aff-9a46-c4c1621d14db is going to be deleted. [ 1328.852190] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.852408] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.852501] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.852623] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f0811b65-cde4-4246-a2e0-5bbd90921f5b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.852779] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.852940] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.853032] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.853149] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e27762cf-c0f5-443d-8332-584b8241d0be" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.853615] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.853773] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.853855] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.853964] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c897dadb-95bc-4de7-a117-d38870fbace8" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.854112] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.854388] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.854388] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.854465] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4bbd48a8-069c-43ef-b15c-47d19b8c7798" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.854640] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.854796] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.854874] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.854987] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-378c3841-8f36-4e7a-8646-033f27e348d9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.855129] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.855317] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.855394] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.855504] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-261361c9-81c8-47fa-9a8a-4e37a8a439d7" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.855630] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.855771] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.855843] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.855948] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fef607f8-3758-4e8a-87f1-a5984690df6e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.856086] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.856227] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.856305] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.856415] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d7acb0b1-c9e7-4016-8d0b-c700463d32e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.856539] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.856677] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.856751] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.856858] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64f74f98-269e-44e8-8235-fe4f7a472b01" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.856979] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.857130] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.857205] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.857333] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6aa4a0c-00bd-46b3-98c1-af4dfb837fa2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.857452] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.857610] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.857685] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.857793] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b37c2faa-a8fb-4eb1-b475-fac73b3fe2ed" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.857919] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.858100] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.858175] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.858285] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c5b5f0f-aa1f-4c63-8e0b-afc494a8bd3a" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.858418] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.858558] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.858630] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.858739] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57b7bbe5-8e54-4d67-b8c6-8cfc418f7042" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.858857] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.858995] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.859082] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.859191] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d160efa7-0312-433f-b94f-cf7e99e24473" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.859310] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.859448] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.859520] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.859619] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5841566c-1d05-4389-b8a7-950b5f9c6708" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.913471] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.913650] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.913711] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.913894] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.913983] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.914120] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f0bcdd73-03e5-43ee-a623-9ac2490cee8f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.008651] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.008834] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.008882] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.009103] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.009335] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.009335] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e50e8525-9eb2-4aff-9a46-c4c1621d14db" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.159027] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 35b651ef-47c8-4ff2-b472-9849f375b8c9: rpc.has_security_group_logging(os_id): False [ 1329.178081] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.178227] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.178279] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.178482] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.197315] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.197626] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.197791] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.197856] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.198015] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.198104] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.198199] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 is going to be updated. [ 1329.250674] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.251085] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.251085] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.251208] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.251290] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.263613] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 in Status: IN_PROGRESS for 2s [ 1331.212862] env[68328]: INFO networking_nsxv3.common.synchronization [req-fba30baa-620e-4b05-b4d1-5ff583cf4b26 req-e91d78d9-fad6-4397-8b15-13d5be4f167c tempest-ServerActionsTestJSON-719988657 tempest-ServerActionsTestJSON-719988657-project-member] Enqueued Resource ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 with Priority: HIGHEST for action security_group_members [ 1331.213375] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 with Priority: HIGHEST for action security_group_members [ 1331.214120] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.214257] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.214324] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.214522] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.214675] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.214788] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.214868] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.214962] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.215053] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.215142] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8024e0cc-9eaa-4282-b00c-9e9b1de030e2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.282964] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 in Status: SUCCESS [ 1331.283242] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.717173] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.717266] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.717347] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.717570] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.737781] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.737781] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.737989] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.737989] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.738148] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.738821] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.738821] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 is going to be updated. [ 1331.761736] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.761868] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.761936] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.762146] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.762276] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.771917] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 in Status: IN_PROGRESS for 2s [ 1333.782364] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 in Status: SUCCESS [ 1333.782733] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 deletion is rescheduled due to dependency. [ 1333.782733] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.213927] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1336.214263] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1338.331953] env[68328]: INFO networking_nsxv3.common.synchronization [req-a3ba655a-561b-443d-85a1-b250525e5a78 req-3f95ccfa-388e-40d9-a132-30d4f9b3c0a0 tempest-ServerActionsTestOtherA-501294167 tempest-ServerActionsTestOtherA-501294167-project-member] Enqueued Resource ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 with Priority: HIGHEST for action security_group_members [ 1338.332278] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 with Priority: HIGHEST for action security_group_members [ 1338.332439] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-35b651ef-47c8-4ff2-b472-9849f375b8c9 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.332499] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.332596] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.332743] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.332895] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.332989] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.333491] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.333704] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.333798] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.333895] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35b651ef-47c8-4ff2-b472-9849f375b8c9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.836050] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('35b651ef-47c8-4ff2-b472-9849f375b8c9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1339.234199] env[68328]: INFO networking_nsxv3.common.synchronization [None req-25f6743c-a732-4db1-9e49-db46a7c53cd8 None None] Enqueued Resource ID: 186f1703-daec-41e5-96db-74c518fcd4a4 with Priority: HIGHEST for action port [ 1339.237030] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 186f1703-daec-41e5-96db-74c518fcd4a4 with Priority: HIGHEST for action port [ 1339.237030] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-186f1703-daec-41e5-96db-74c518fcd4a4 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.237030] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-186f1703-daec-41e5-96db-74c518fcd4a4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.237030] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-186f1703-daec-41e5-96db-74c518fcd4a4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.237030] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-186f1703-daec-41e5-96db-74c518fcd4a4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.237030] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('186f1703-daec-41e5-96db-74c518fcd4a4',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1339.339044] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('35b651ef-47c8-4ff2-b472-9849f375b8c9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1339.741094] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 186f1703-daec-41e5-96db-74c518fcd4a4 [ 1339.741094] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.741094] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.741094] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.741094] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.741094] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.741094] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:186f1703-daec-41e5-96db-74c518fcd4a4 already deleted. [ 1339.741094] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-186f1703-daec-41e5-96db-74c518fcd4a4" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.841271] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.841422] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.841488] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.841711] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.841830] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.841968] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 is going to be updated. [ 1339.872888] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.873068] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.873113] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.874804] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.874804] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.883165] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 in Status: IN_PROGRESS for 2s [ 1341.397159] env[68328]: INFO networking_nsxv3.common.synchronization [None req-e73c8ad1-1b54-4014-928e-2a60e001b132 None None] Enqueued Resource ID: e912070d-a819-48bf-b4dd-2453034a2fdd with Priority: HIGHEST for action port [ 1341.397159] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e912070d-a819-48bf-b4dd-2453034a2fdd with Priority: HIGHEST for action port [ 1341.397159] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-e912070d-a819-48bf-b4dd-2453034a2fdd taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.397159] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e912070d-a819-48bf-b4dd-2453034a2fdd" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.397159] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e912070d-a819-48bf-b4dd-2453034a2fdd" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.399272] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e912070d-a819-48bf-b4dd-2453034a2fdd" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.399272] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e912070d-a819-48bf-b4dd-2453034a2fdd',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.508809] env[68328]: INFO networking_nsxv3.common.synchronization [None req-1cbcf24e-6a14-461a-8dd2-3cd7341e9d96 None None] Enqueued Resource ID: 6a910202-5c75-463f-9274-888f135bcc9c with Priority: HIGHEST for action port [ 1341.517054] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a910202-5c75-463f-9274-888f135bcc9c with Priority: HIGHEST for action port [ 1341.517054] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a910202-5c75-463f-9274-888f135bcc9c taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.517054] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a910202-5c75-463f-9274-888f135bcc9c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.517054] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a910202-5c75-463f-9274-888f135bcc9c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.517054] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a910202-5c75-463f-9274-888f135bcc9c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.517736] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a910202-5c75-463f-9274-888f135bcc9c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.894287] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 in Status: SUCCESS [ 1341.894567] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.900202] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e912070d-a819-48bf-b4dd-2453034a2fdd [ 1341.900435] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.900583] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.900689] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.900934] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.901064] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.901164] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e912070d-a819-48bf-b4dd-2453034a2fdd already deleted. [ 1341.901346] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e912070d-a819-48bf-b4dd-2453034a2fdd" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.021078] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6a910202-5c75-463f-9274-888f135bcc9c [ 1342.021311] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.021437] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.021502] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.021746] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.021805] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.021888] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6a910202-5c75-463f-9274-888f135bcc9c already deleted. [ 1342.021966] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a910202-5c75-463f-9274-888f135bcc9c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.573499] env[68328]: INFO networking_nsxv3.common.synchronization [None req-c4ad9c53-fc99-40e3-ac38-7e8edc405cee None None] Enqueued Resource ID: 688ba77c-a887-4529-acf6-2fd4971bf54c with Priority: HIGHEST for action port [ 1343.573809] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 688ba77c-a887-4529-acf6-2fd4971bf54c with Priority: HIGHEST for action port [ 1343.574369] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-688ba77c-a887-4529-acf6-2fd4971bf54c taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.574475] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-688ba77c-a887-4529-acf6-2fd4971bf54c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.574547] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-688ba77c-a887-4529-acf6-2fd4971bf54c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.574791] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-688ba77c-a887-4529-acf6-2fd4971bf54c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.574873] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('688ba77c-a887-4529-acf6-2fd4971bf54c',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.076749] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 688ba77c-a887-4529-acf6-2fd4971bf54c [ 1344.077020] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.077181] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.077272] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.077512] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.077615] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.077733] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:688ba77c-a887-4529-acf6-2fd4971bf54c already deleted. [ 1344.077833] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-688ba77c-a887-4529-acf6-2fd4971bf54c" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.876661] env[68328]: INFO networking_nsxv3.common.synchronization [req-3af27341-1676-4d74-b8d7-751f950dfe48 req-7e6d755a-a2b5-46d5-ac55-e1bc35caf9e5 tempest-ServersNegativeTestMultiTenantJSON-1101295360 tempest-ServersNegativeTestMultiTenantJSON-1101295360-project-member] Enqueued Resource ID: 10934b61-bf3e-4502-a16d-4256b90c2f37 with Priority: HIGHEST for action security_group_members [ 1346.877191] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10934b61-bf3e-4502-a16d-4256b90c2f37 with Priority: HIGHEST for action security_group_members [ 1346.877493] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-10934b61-bf3e-4502-a16d-4256b90c2f37 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.877643] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10934b61-bf3e-4502-a16d-4256b90c2f37" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.877748] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10934b61-bf3e-4502-a16d-4256b90c2f37" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.878127] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10934b61-bf3e-4502-a16d-4256b90c2f37" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.878214] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.878664] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.878737] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.878897] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.878984] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.879089] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10934b61-bf3e-4502-a16d-4256b90c2f37',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.121935] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-703 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.122169] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-703" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.122280] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-703" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.122657] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-703" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.122970] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.123162] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.123284] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.123630] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.123771] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.124038] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1347.124111] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1347.124205] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1347.124691] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1347.124691] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1347.124691] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1347.125114] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1347.143496] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1347.143607] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1347.144068] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1347.144068] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-703" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.144379] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-c20df018-7d6b-4c5f-ab52-c189bd10318e taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.145347] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-c20df018-7d6b-4c5f-ab52-c189bd10318e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.145347] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-c20df018-7d6b-4c5f-ab52-c189bd10318e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.145347] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-c20df018-7d6b-4c5f-ab52-c189bd10318e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.145347] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c20df018-7d6b-4c5f-ab52-c189bd10318e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.381374] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.381606] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.381606] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.381741] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.381829] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.382043] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.382136] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.382192] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.382343] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.382417] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.382503] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10934b61-bf3e-4502-a16d-4256b90c2f37 already deleted. [ 1347.382621] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10934b61-bf3e-4502-a16d-4256b90c2f37" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.650252] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.650464] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.650612] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.650861] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.651019] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.651178] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port c20df018-7d6b-4c5f-ab52-c189bd10318e not found, creating... [ 1347.651439] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.651646] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.651779] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.651937] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.652096] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.652390] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.652547] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.652663] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.652874] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.653021] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.653177] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: c20df018-7d6b-4c5f-ab52-c189bd10318e is going to be created. [ 1347.671079] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.671349] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.671536] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.672076] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.672076] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.672248] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-c20df018-7d6b-4c5f-ab52-c189bd10318e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.465246] env[68328]: INFO networking_nsxv3.common.synchronization [req-3af27341-1676-4d74-b8d7-751f950dfe48 req-73fd368d-7045-43c2-b32c-23be56625e47 service nova] Enqueued Resource ID: 10934b61-bf3e-4502-a16d-4256b90c2f37 with Priority: HIGHEST for action security_group_rules [ 1348.465539] env[68328]: INFO networking_nsxv3.common.synchronization [req-3af27341-1676-4d74-b8d7-751f950dfe48 req-73fd368d-7045-43c2-b32c-23be56625e47 service nova] Enqueued Resource ID: 10934b61-bf3e-4502-a16d-4256b90c2f37 with Priority: HIGHEST for action security_group_members [ 1348.465635] env[68328]: INFO networking_nsxv3.common.synchronization [req-3af27341-1676-4d74-b8d7-751f950dfe48 req-73fd368d-7045-43c2-b32c-23be56625e47 service nova] Enqueued Resource ID: c20df018-7d6b-4c5f-ab52-c189bd10318e with Priority: HIGHEST for action port [ 1348.465859] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10934b61-bf3e-4502-a16d-4256b90c2f37 with Priority: HIGHEST for action security_group_rules [ 1348.465984] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10934b61-bf3e-4502-a16d-4256b90c2f37 with Priority: HIGHEST for action security_group_members [ 1348.466091] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c20df018-7d6b-4c5f-ab52-c189bd10318e with Priority: HIGHEST for action port [ 1348.466622] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-10934b61-bf3e-4502-a16d-4256b90c2f37 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.466752] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-10934b61-bf3e-4502-a16d-4256b90c2f37" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.466795] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-10934b61-bf3e-4502-a16d-4256b90c2f37" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.467056] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-10934b61-bf3e-4502-a16d-4256b90c2f37" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.467179] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('10934b61-bf3e-4502-a16d-4256b90c2f37',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1348.467998] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-10934b61-bf3e-4502-a16d-4256b90c2f37 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.468116] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10934b61-bf3e-4502-a16d-4256b90c2f37" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.468238] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10934b61-bf3e-4502-a16d-4256b90c2f37" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.468354] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10934b61-bf3e-4502-a16d-4256b90c2f37" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.468496] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.468586] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.468644] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.468785] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.468866] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.468953] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10934b61-bf3e-4502-a16d-4256b90c2f37',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1348.469663] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-c20df018-7d6b-4c5f-ab52-c189bd10318e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.469762] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c20df018-7d6b-4c5f-ab52-c189bd10318e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.469830] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c20df018-7d6b-4c5f-ab52-c189bd10318e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.469976] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c20df018-7d6b-4c5f-ab52-c189bd10318e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.470060] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c20df018-7d6b-4c5f-ab52-c189bd10318e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1348.973029] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-10934b61-bf3e-4502-a16d-4256b90c2f37 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.973029] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10934b61-bf3e-4502-a16d-4256b90c2f37" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.973029] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('10934b61-bf3e-4502-a16d-4256b90c2f37',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1348.973670] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c20df018-7d6b-4c5f-ab52-c189bd10318e with status ACTIVE [ 1348.973670] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.973670] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.973670] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.973883] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.973966] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.974147] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.974251] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.974310] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.974470] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.974576] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.975324] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.975324] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.975324] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.975324] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.975324] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.975324] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c20df018-7d6b-4c5f-ab52-c189bd10318e is going to be updated. [ 1348.995966] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.996117] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.996172] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.996500] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.996500] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.996642] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c20df018-7d6b-4c5f-ab52-c189bd10318e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.477371] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('10934b61-bf3e-4502-a16d-4256b90c2f37',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.981830] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.982014] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.982074] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.982282] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.982374] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.982474] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10934b61-bf3e-4502-a16d-4256b90c2f37 is going to be created. [ 1350.005672] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.005827] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.005888] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.006033] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.006185] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.014789] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10934b61-bf3e-4502-a16d-4256b90c2f37 in Status: UNINITIALIZED for 2s [ 1352.026174] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10934b61-bf3e-4502-a16d-4256b90c2f37 in Status: SUCCESS [ 1352.026554] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10934b61-bf3e-4502-a16d-4256b90c2f37" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.026554] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10934b61-bf3e-4502-a16d-4256b90c2f37" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.026748] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10934b61-bf3e-4502-a16d-4256b90c2f37" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.026944] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.027073] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.027145] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.027297] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.027377] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.027464] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10934b61-bf3e-4502-a16d-4256b90c2f37" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.027556] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('10934b61-bf3e-4502-a16d-4256b90c2f37',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1352.056013] env[68328]: INFO networking_nsxv3.common.synchronization [req-360d3a3a-c041-424d-b04e-24fec4aa102d req-a201ce0e-6a67-4adc-99c5-f56f655bf1d9 tempest-AttachVolumeShelveTestJSON-1223620556 tempest-AttachVolumeShelveTestJSON-1223620556-project-member] Enqueued Resource ID: b1c2fa85-ca03-4043-a12f-6ed71cf5c151 with Priority: HIGHEST for action security_group_members [ 1352.056516] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1c2fa85-ca03-4043-a12f-6ed71cf5c151 with Priority: HIGHEST for action security_group_members [ 1352.056812] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1c2fa85-ca03-4043-a12f-6ed71cf5c151 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.056932] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1c2fa85-ca03-4043-a12f-6ed71cf5c151" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.057049] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1c2fa85-ca03-4043-a12f-6ed71cf5c151" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.057198] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1c2fa85-ca03-4043-a12f-6ed71cf5c151" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.057348] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.057996] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.057996] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.057996] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.057996] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.057996] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1c2fa85-ca03-4043-a12f-6ed71cf5c151',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1352.530031] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-10934b61-bf3e-4502-a16d-4256b90c2f37 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.530206] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10934b61-bf3e-4502-a16d-4256b90c2f37" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.530286] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10934b61-bf3e-4502-a16d-4256b90c2f37" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.530453] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10934b61-bf3e-4502-a16d-4256b90c2f37" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.530614] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.530718] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.530771] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.530936] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.531526] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.531526] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10934b61-bf3e-4502-a16d-4256b90c2f37" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.531526] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-10934b61-bf3e-4502-a16d-4256b90c2f37 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.531526] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10934b61-bf3e-4502-a16d-4256b90c2f37" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.531526] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10934b61-bf3e-4502-a16d-4256b90c2f37" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.531526] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10934b61-bf3e-4502-a16d-4256b90c2f37" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.531880] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.531880] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.531880] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.531880] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.532207] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.532207] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10934b61-bf3e-4502-a16d-4256b90c2f37" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.532207] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('10934b61-bf3e-4502-a16d-4256b90c2f37',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1352.562073] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.562073] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.562073] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.562073] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.581479] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.581479] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.581479] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.581479] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.581479] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.581479] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.581479] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1c2fa85-ca03-4043-a12f-6ed71cf5c151 is going to be updated. [ 1352.603049] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.603049] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.603049] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.603049] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.603049] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.610085] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1c2fa85-ca03-4043-a12f-6ed71cf5c151 in Status: IN_PROGRESS for 2s [ 1353.034340] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 10934b61-bf3e-4502-a16d-4256b90c2f37: rpc.has_security_group_logging(os_id): False [ 1353.056161] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.056321] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.056409] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.056619] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.056791] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.056909] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.057011] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.057077] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.057232] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.057308] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.057533] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.057587] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.057652] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.057792] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.057868] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.058079] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.058168] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.058227] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.058369] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.058446] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.058530] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 10934b61-bf3e-4502-a16d-4256b90c2f37 is going to be created. [ 1353.121628] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.121809] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.121809] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.121984] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.122168] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.134962] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 10934b61-bf3e-4502-a16d-4256b90c2f37 in Status: IN_PROGRESS for 2s [ 1354.623758] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1c2fa85-ca03-4043-a12f-6ed71cf5c151 in Status: SUCCESS [ 1354.623984] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1c2fa85-ca03-4043-a12f-6ed71cf5c151 deletion is rescheduled due to dependency. [ 1354.623984] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1c2fa85-ca03-4043-a12f-6ed71cf5c151" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.851196] env[68328]: INFO networking_nsxv3.common.synchronization [req-7cf59889-6cff-4923-8bd4-eb0ab0effe0f req-1922e91a-c7f8-4b90-a865-dd848d265730 tempest-ServerActionsTestOtherA-501294167 tempest-ServerActionsTestOtherA-501294167-project-member] Enqueued Resource ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 with Priority: HIGHEST for action security_group_members [ 1354.851733] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 with Priority: HIGHEST for action security_group_members [ 1354.852045] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-35b651ef-47c8-4ff2-b472-9849f375b8c9 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.852169] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.852236] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.852442] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.852588] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.852681] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.852741] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.852883] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.852967] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.853069] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35b651ef-47c8-4ff2-b472-9849f375b8c9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.147629] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 10934b61-bf3e-4502-a16d-4256b90c2f37 in Status: SUCCESS [ 1355.147823] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-10934b61-bf3e-4502-a16d-4256b90c2f37" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.355160] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.355324] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.355395] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.355664] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.355772] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.355976] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.356085] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.356147] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.356293] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.356368] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.356460] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 is going to be updated. [ 1355.389338] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.389483] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.389545] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.389751] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.389885] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.403755] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 in Status: IN_PROGRESS for 2s [ 1355.801354] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-507 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.801678] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-507" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.801728] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-507" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.802327] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-507" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.802327] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.802503] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.802579] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.802790] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.802940] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.803329] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1355.803456] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1355.803573] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1355.803688] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1355.803803] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1355.803913] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1355.804064] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1355.822599] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1355.822767] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1355.822910] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1355.823096] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-507" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.823391] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-3c2f2ce6-bca9-4b56-9f36-0c3e93ee3321 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.823574] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-3c2f2ce6-bca9-4b56-9f36-0c3e93ee3321" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.823679] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-3c2f2ce6-bca9-4b56-9f36-0c3e93ee3321" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.823922] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-3c2f2ce6-bca9-4b56-9f36-0c3e93ee3321" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.824091] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c2f2ce6-bca9-4b56-9f36-0c3e93ee3321',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1356.326034] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.326261] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.326392] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.326872] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.327065] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.327379] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.327554] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.327681] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.327922] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.328080] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.328372] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.328531] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.328656] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.328864] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.329010] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.329163] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 3c2f2ce6-bca9-4b56-9f36-0c3e93ee3321 is going to be updated. [ 1356.351487] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.351690] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.352150] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.352150] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.352281] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.352512] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-3c2f2ce6-bca9-4b56-9f36-0c3e93ee3321" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.051837] env[68328]: INFO networking_nsxv3.common.synchronization [req-aac6f37b-8ec0-43cb-a4c3-06c0b0e914b6 req-68eb8cdb-9718-4368-96c8-296b45a773ff service nova] Enqueued Resource ID: 54390b69-5280-4540-a63f-fa4daae4a11f with Priority: HIGHEST for action security_group_rules [ 1357.052253] env[68328]: INFO networking_nsxv3.common.synchronization [req-aac6f37b-8ec0-43cb-a4c3-06c0b0e914b6 req-68eb8cdb-9718-4368-96c8-296b45a773ff service nova] Enqueued Resource ID: 54390b69-5280-4540-a63f-fa4daae4a11f with Priority: HIGHEST for action security_group_members [ 1357.052253] env[68328]: INFO networking_nsxv3.common.synchronization [req-aac6f37b-8ec0-43cb-a4c3-06c0b0e914b6 req-68eb8cdb-9718-4368-96c8-296b45a773ff service nova] Enqueued Resource ID: 3c2f2ce6-bca9-4b56-9f36-0c3e93ee3321 with Priority: HIGHEST for action port [ 1357.052417] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54390b69-5280-4540-a63f-fa4daae4a11f with Priority: HIGHEST for action security_group_rules [ 1357.052541] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54390b69-5280-4540-a63f-fa4daae4a11f with Priority: HIGHEST for action security_group_members [ 1357.052641] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c2f2ce6-bca9-4b56-9f36-0c3e93ee3321 with Priority: HIGHEST for action port [ 1357.053615] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54390b69-5280-4540-a63f-fa4daae4a11f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.053690] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.053744] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.053988] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.054041] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54390b69-5280-4540-a63f-fa4daae4a11f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1357.054800] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-54390b69-5280-4540-a63f-fa4daae4a11f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.054912] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.054984] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.055145] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.055289] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.055383] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.055445] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.055599] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.055849] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.055849] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54390b69-5280-4540-a63f-fa4daae4a11f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1357.056446] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c2f2ce6-bca9-4b56-9f36-0c3e93ee3321 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.056584] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c2f2ce6-bca9-4b56-9f36-0c3e93ee3321" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.056653] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c2f2ce6-bca9-4b56-9f36-0c3e93ee3321" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.056899] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c2f2ce6-bca9-4b56-9f36-0c3e93ee3321" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.056899] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c2f2ce6-bca9-4b56-9f36-0c3e93ee3321',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1357.413628] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 in Status: SUCCESS [ 1357.413823] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 deletion is rescheduled due to dependency. [ 1357.413931] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.559462] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('54390b69-5280-4540-a63f-fa4daae4a11f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1357.560742] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-54390b69-5280-4540-a63f-fa4daae4a11f taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.560876] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.561059] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3c2f2ce6-bca9-4b56-9f36-0c3e93ee3321 with status ACTIVE [ 1357.561238] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.561351] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.561416] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.561617] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.561706] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.561919] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.562064] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.562139] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.562346] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.562456] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.562690] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.562870] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.562922] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.563085] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.563177] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.563298] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3c2f2ce6-bca9-4b56-9f36-0c3e93ee3321 is going to be updated. [ 1357.583243] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.583459] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.583459] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.583711] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.583844] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.584041] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c2f2ce6-bca9-4b56-9f36-0c3e93ee3321" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.065193] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('54390b69-5280-4540-a63f-fa4daae4a11f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.134313] env[68328]: INFO networking_nsxv3.common.synchronization [req-a2b8fa17-ccad-413b-be12-925973c2354c req-2177001d-bdf5-4bb0-bb7c-9c562c1fc737 tempest-ServersNegativeTestMultiTenantJSON-1101295360 tempest-ServersNegativeTestMultiTenantJSON-1101295360-project-member] Enqueued Resource ID: 10934b61-bf3e-4502-a16d-4256b90c2f37 with Priority: HIGHEST for action security_group_members [ 1358.134313] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10934b61-bf3e-4502-a16d-4256b90c2f37 with Priority: HIGHEST for action security_group_members [ 1358.134572] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-10934b61-bf3e-4502-a16d-4256b90c2f37 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.134694] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10934b61-bf3e-4502-a16d-4256b90c2f37" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.134760] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10934b61-bf3e-4502-a16d-4256b90c2f37" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.134956] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10934b61-bf3e-4502-a16d-4256b90c2f37" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.135233] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.135338] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.135402] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.135601] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.135765] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.135765] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10934b61-bf3e-4502-a16d-4256b90c2f37',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.567717] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.567889] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.567961] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.568223] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.568295] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.568397] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54390b69-5280-4540-a63f-fa4daae4a11f is going to be updated. [ 1358.596985] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.597159] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.597207] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.597414] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.597548] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.611249] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54390b69-5280-4540-a63f-fa4daae4a11f in Status: IN_PROGRESS for 2s [ 1358.638237] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.638478] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.638591] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.638896] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.639068] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.639585] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.639585] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.639799] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.640519] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.640519] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.640519] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10934b61-bf3e-4502-a16d-4256b90c2f37 is going to be updated. [ 1358.667588] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.667739] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.667790] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.668138] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.668138] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.677570] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10934b61-bf3e-4502-a16d-4256b90c2f37 in Status: IN_PROGRESS for 2s [ 1360.637750] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54390b69-5280-4540-a63f-fa4daae4a11f in Status: SUCCESS [ 1360.638057] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.638188] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.638408] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.638600] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.638717] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.638782] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.638927] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.639016] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.639116] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.639195] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('54390b69-5280-4540-a63f-fa4daae4a11f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1360.685700] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10934b61-bf3e-4502-a16d-4256b90c2f37 in Status: SUCCESS [ 1360.685938] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10934b61-bf3e-4502-a16d-4256b90c2f37 deletion is rescheduled due to dependency. [ 1360.686029] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10934b61-bf3e-4502-a16d-4256b90c2f37" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.141377] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('54390b69-5280-4540-a63f-fa4daae4a11f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.644484] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 54390b69-5280-4540-a63f-fa4daae4a11f: rpc.has_security_group_logging(os_id): False [ 1361.663379] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.663581] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.663581] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.663789] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.681996] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.682947] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.683352] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.683562] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.683845] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.683983] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.684205] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54390b69-5280-4540-a63f-fa4daae4a11f is going to be updated. [ 1361.735700] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.735846] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.735933] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.736203] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.736393] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.747438] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54390b69-5280-4540-a63f-fa4daae4a11f in Status: IN_PROGRESS for 2s [ 1363.135251] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1363.135673] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1363.769040] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54390b69-5280-4540-a63f-fa4daae4a11f in Status: SUCCESS [ 1363.769040] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.860230] env[68328]: INFO networking_nsxv3.common.synchronization [None req-b9d0031f-7422-446d-9e6f-88a951d77225 None None] Enqueued Resource ID: cea6a500-570f-46d4-b01f-a59f1b6bb203 with Priority: HIGHEST for action port [ 1367.860494] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cea6a500-570f-46d4-b01f-a59f1b6bb203 with Priority: HIGHEST for action port [ 1367.861540] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-cea6a500-570f-46d4-b01f-a59f1b6bb203 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.861540] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cea6a500-570f-46d4-b01f-a59f1b6bb203" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.861540] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cea6a500-570f-46d4-b01f-a59f1b6bb203" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.861540] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cea6a500-570f-46d4-b01f-a59f1b6bb203" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.861540] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cea6a500-570f-46d4-b01f-a59f1b6bb203',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1368.067086] env[68328]: INFO networking_nsxv3.common.synchronization [None req-0bb64da3-4f35-41b3-be71-a916f4b6d96b tempest-AttachVolumeNegativeTest-1504481414 tempest-AttachVolumeNegativeTest-1504481414-project-member] Enqueued Resource ID: c2821544-c3c0-47e5-aba8-84dac3283194 with Priority: HIGHEST for action security_group_rules [ 1368.067632] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2821544-c3c0-47e5-aba8-84dac3283194 with Priority: HIGHEST for action security_group_rules [ 1368.067961] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c2821544-c3c0-47e5-aba8-84dac3283194 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.068108] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c2821544-c3c0-47e5-aba8-84dac3283194" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.068176] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c2821544-c3c0-47e5-aba8-84dac3283194" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.068434] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c2821544-c3c0-47e5-aba8-84dac3283194" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.068516] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c2821544-c3c0-47e5-aba8-84dac3283194',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1368.143445] env[68328]: INFO networking_nsxv3.common.synchronization [None req-4e996692-f3cc-4944-9559-4802d978664c tempest-AttachVolumeNegativeTest-1504481414 tempest-AttachVolumeNegativeTest-1504481414-project-member] Enqueued Resource ID: c2821544-c3c0-47e5-aba8-84dac3283194 with Priority: HIGHEST for action security_group_rules [ 1368.144028] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2821544-c3c0-47e5-aba8-84dac3283194 with Priority: HIGHEST for action security_group_rules [ 1368.144352] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c2821544-c3c0-47e5-aba8-84dac3283194 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.144459] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c2821544-c3c0-47e5-aba8-84dac3283194" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.363900] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cea6a500-570f-46d4-b01f-a59f1b6bb203 [ 1368.365177] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.365177] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.365177] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.365177] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.365177] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.365507] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cea6a500-570f-46d4-b01f-a59f1b6bb203 already deleted. [ 1368.365507] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cea6a500-570f-46d4-b01f-a59f1b6bb203" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.592460] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.592670] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.592724] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.592990] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.593118] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.593232] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c2821544-c3c0-47e5-aba8-84dac3283194 already deleted. [ 1368.593321] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c2821544-c3c0-47e5-aba8-84dac3283194" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.593517] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c2821544-c3c0-47e5-aba8-84dac3283194" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.594612] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c2821544-c3c0-47e5-aba8-84dac3283194" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.594612] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c2821544-c3c0-47e5-aba8-84dac3283194',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1369.112964] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.113307] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.113307] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.113390] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.113464] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.113587] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c2821544-c3c0-47e5-aba8-84dac3283194 already deleted. [ 1369.113673] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c2821544-c3c0-47e5-aba8-84dac3283194" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.972437] env[68328]: INFO networking_nsxv3.common.synchronization [None req-9e47dea9-72f5-4bb9-9723-34e3cf98871b None None] Enqueued Resource ID: 2be21735-a462-4923-9252-d5ccfc5e3ae1 with Priority: HIGHEST for action port [ 1369.972437] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2be21735-a462-4923-9252-d5ccfc5e3ae1 with Priority: HIGHEST for action port [ 1369.973210] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-2be21735-a462-4923-9252-d5ccfc5e3ae1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.973395] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2be21735-a462-4923-9252-d5ccfc5e3ae1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.973495] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2be21735-a462-4923-9252-d5ccfc5e3ae1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.973833] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2be21735-a462-4923-9252-d5ccfc5e3ae1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.973950] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2be21735-a462-4923-9252-d5ccfc5e3ae1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1370.477826] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2be21735-a462-4923-9252-d5ccfc5e3ae1 [ 1370.478214] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.478292] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.478341] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.478529] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.478631] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.478710] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2be21735-a462-4923-9252-d5ccfc5e3ae1 already deleted. [ 1370.478794] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2be21735-a462-4923-9252-d5ccfc5e3ae1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.411959] env[68328]: INFO networking_nsxv3.common.synchronization [req-1c1c3237-0a61-4759-9429-a1f344067fb2 req-f9a504f2-688d-4237-88ee-b90e2413926c tempest-AttachVolumeNegativeTest-1504481414 tempest-AttachVolumeNegativeTest-1504481414-project-member] Enqueued Resource ID: c2821544-c3c0-47e5-aba8-84dac3283194 with Priority: HIGHEST for action security_group_members [ 1373.412494] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2821544-c3c0-47e5-aba8-84dac3283194 with Priority: HIGHEST for action security_group_members [ 1373.412799] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2821544-c3c0-47e5-aba8-84dac3283194 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.412919] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2821544-c3c0-47e5-aba8-84dac3283194" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.412988] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2821544-c3c0-47e5-aba8-84dac3283194" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.413246] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2821544-c3c0-47e5-aba8-84dac3283194" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.413410] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.413524] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.413583] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.413705] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.413788] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.413880] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2821544-c3c0-47e5-aba8-84dac3283194',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1373.668142] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-946 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.668471] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-946" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.668728] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-946" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.669135] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-946" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.669479] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.669686] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.669872] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.670128] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.670282] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.670498] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1373.670961] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1373.671099] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1373.671250] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1373.671384] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1373.671501] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1373.671645] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1373.692157] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1373.692326] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1373.692530] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1373.692795] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-946" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.693176] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-136ceaec-9b96-4f2c-8680-0a1d262ff447 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.693403] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-136ceaec-9b96-4f2c-8680-0a1d262ff447" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.693541] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-136ceaec-9b96-4f2c-8680-0a1d262ff447" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.693907] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-136ceaec-9b96-4f2c-8680-0a1d262ff447" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.694091] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('136ceaec-9b96-4f2c-8680-0a1d262ff447',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1373.916144] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.916315] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.916315] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.916535] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.916638] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.916840] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.916941] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.917019] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.917170] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.917248] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.917331] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2821544-c3c0-47e5-aba8-84dac3283194 already deleted. [ 1373.917410] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2821544-c3c0-47e5-aba8-84dac3283194" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.196811] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.197693] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.197693] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.197693] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.197693] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.197926] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 136ceaec-9b96-4f2c-8680-0a1d262ff447 not found, creating... [ 1374.198099] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.198209] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.198332] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.198861] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.198861] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.198970] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.199501] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.199501] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.199501] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.199653] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.199745] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 136ceaec-9b96-4f2c-8680-0a1d262ff447 is going to be created. [ 1374.220747] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.221080] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.221282] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.221643] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.221974] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.222298] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-136ceaec-9b96-4f2c-8680-0a1d262ff447" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.235452] env[68328]: INFO networking_nsxv3.common.synchronization [req-35513b14-9fbb-4759-825b-1294c3e2cd79 req-76d8faa1-6e83-4b31-8384-63f73a06a487 tempest-ServerActionsTestOtherB-24837534 tempest-ServerActionsTestOtherB-24837534-project-member] Enqueued Resource ID: 54390b69-5280-4540-a63f-fa4daae4a11f with Priority: HIGHEST for action security_group_members [ 1374.235564] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54390b69-5280-4540-a63f-fa4daae4a11f with Priority: HIGHEST for action security_group_members [ 1374.236139] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-54390b69-5280-4540-a63f-fa4daae4a11f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.236274] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.236320] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.237047] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.237047] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.237047] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.237047] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.237368] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.237460] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.237696] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54390b69-5280-4540-a63f-fa4daae4a11f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1374.739555] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.739829] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.739829] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.740029] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.740090] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.740285] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.740380] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.740434] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.740583] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.740657] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.740745] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54390b69-5280-4540-a63f-fa4daae4a11f is going to be updated. [ 1374.768055] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.768254] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.768254] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.768441] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.768577] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.778630] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54390b69-5280-4540-a63f-fa4daae4a11f in Status: IN_PROGRESS for 2s [ 1374.896318] env[68328]: INFO networking_nsxv3.common.synchronization [req-1c1c3237-0a61-4759-9429-a1f344067fb2 req-094582d1-a5d5-4217-a4a6-bb0df10bb1a2 service nova] Enqueued Resource ID: c2821544-c3c0-47e5-aba8-84dac3283194 with Priority: HIGHEST for action security_group_rules [ 1374.896318] env[68328]: INFO networking_nsxv3.common.synchronization [req-1c1c3237-0a61-4759-9429-a1f344067fb2 req-094582d1-a5d5-4217-a4a6-bb0df10bb1a2 service nova] Enqueued Resource ID: c2821544-c3c0-47e5-aba8-84dac3283194 with Priority: HIGHEST for action security_group_members [ 1374.896318] env[68328]: INFO networking_nsxv3.common.synchronization [req-1c1c3237-0a61-4759-9429-a1f344067fb2 req-094582d1-a5d5-4217-a4a6-bb0df10bb1a2 service nova] Enqueued Resource ID: 136ceaec-9b96-4f2c-8680-0a1d262ff447 with Priority: HIGHEST for action port [ 1374.896318] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2821544-c3c0-47e5-aba8-84dac3283194 with Priority: HIGHEST for action security_group_rules [ 1374.896661] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2821544-c3c0-47e5-aba8-84dac3283194 with Priority: HIGHEST for action security_group_members [ 1374.896876] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 136ceaec-9b96-4f2c-8680-0a1d262ff447 with Priority: HIGHEST for action port [ 1374.898180] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c2821544-c3c0-47e5-aba8-84dac3283194 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.898412] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c2821544-c3c0-47e5-aba8-84dac3283194" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.898567] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c2821544-c3c0-47e5-aba8-84dac3283194" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.898848] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c2821544-c3c0-47e5-aba8-84dac3283194" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.899042] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c2821544-c3c0-47e5-aba8-84dac3283194',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1374.900216] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2821544-c3c0-47e5-aba8-84dac3283194 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.900450] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2821544-c3c0-47e5-aba8-84dac3283194" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.900606] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2821544-c3c0-47e5-aba8-84dac3283194" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.900864] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2821544-c3c0-47e5-aba8-84dac3283194" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.901119] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.901337] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.901491] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.901720] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.901897] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.902163] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2821544-c3c0-47e5-aba8-84dac3283194',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1374.902956] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-136ceaec-9b96-4f2c-8680-0a1d262ff447 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.903935] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-136ceaec-9b96-4f2c-8680-0a1d262ff447" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.903935] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-136ceaec-9b96-4f2c-8680-0a1d262ff447" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.903935] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-136ceaec-9b96-4f2c-8680-0a1d262ff447" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.903935] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('136ceaec-9b96-4f2c-8680-0a1d262ff447',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1375.404971] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2821544-c3c0-47e5-aba8-84dac3283194 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.405119] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2821544-c3c0-47e5-aba8-84dac3283194" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.405304] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c2821544-c3c0-47e5-aba8-84dac3283194',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1375.406183] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 136ceaec-9b96-4f2c-8680-0a1d262ff447 with status ACTIVE [ 1375.406392] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.406476] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.406534] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.406774] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.406865] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.407032] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.407131] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.407178] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.407717] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.407717] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.407717] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.407717] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.407717] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.408018] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.408018] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.408018] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 136ceaec-9b96-4f2c-8680-0a1d262ff447 is going to be updated. [ 1375.452742] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.452895] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.452936] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.453109] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.453235] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.453385] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-136ceaec-9b96-4f2c-8680-0a1d262ff447" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.909628] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c2821544-c3c0-47e5-aba8-84dac3283194',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1376.412643] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.412856] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.412965] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.413269] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.413384] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.413511] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2821544-c3c0-47e5-aba8-84dac3283194 is going to be created. [ 1376.438286] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.438452] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.438503] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.438724] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.438906] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.447712] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2821544-c3c0-47e5-aba8-84dac3283194 in Status: UNINITIALIZED for 2s [ 1376.788630] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54390b69-5280-4540-a63f-fa4daae4a11f in Status: SUCCESS [ 1376.788833] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54390b69-5280-4540-a63f-fa4daae4a11f deletion is rescheduled due to dependency. [ 1376.788909] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.457517] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2821544-c3c0-47e5-aba8-84dac3283194 in Status: SUCCESS [ 1378.457902] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2821544-c3c0-47e5-aba8-84dac3283194" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.457902] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2821544-c3c0-47e5-aba8-84dac3283194" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.457984] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2821544-c3c0-47e5-aba8-84dac3283194" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.458215] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.458329] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.458395] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.458557] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.458638] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.458722] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2821544-c3c0-47e5-aba8-84dac3283194" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.458814] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c2821544-c3c0-47e5-aba8-84dac3283194',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1378.961715] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c2821544-c3c0-47e5-aba8-84dac3283194',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1379.464962] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c2821544-c3c0-47e5-aba8-84dac3283194: rpc.has_security_group_logging(os_id): False [ 1379.482627] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.482756] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.482835] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.483045] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.483130] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.483348] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.483445] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.483514] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.483665] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.483763] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.483853] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c2821544-c3c0-47e5-aba8-84dac3283194 is going to be created. [ 1379.541738] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.541905] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.541905] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.542111] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.542277] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.551910] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2821544-c3c0-47e5-aba8-84dac3283194 in Status: IN_PROGRESS for 2s [ 1379.898691] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1379.898911] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1381.564325] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c2821544-c3c0-47e5-aba8-84dac3283194 in Status: SUCCESS [ 1381.564650] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c2821544-c3c0-47e5-aba8-84dac3283194" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.900049] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1384.900049] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1389.900938] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1389.901378] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1394.902186] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1394.902548] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1399.902908] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1399.903288] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1404.904338] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1404.904736] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1409.905277] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1409.905658] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1414.906096] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1414.906597] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1419.907951] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1419.908303] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1424.909187] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1424.909590] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1429.910871] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1429.911262] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1430.871936] env[68328]: INFO networking_nsxv3.common.synchronization [None req-36198eab-35fb-469f-8761-e5f7af90c1f2 tempest-AttachVolumeNegativeTest-1504481414 tempest-AttachVolumeNegativeTest-1504481414-project-member] Enqueued Resource ID: d1028f99-d6d9-44b2-b613-831f71a9b129 with Priority: HIGHEST for action security_group_rules [ 1430.872131] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1028f99-d6d9-44b2-b613-831f71a9b129 with Priority: HIGHEST for action security_group_rules [ 1430.872466] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1028f99-d6d9-44b2-b613-831f71a9b129 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.872590] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1028f99-d6d9-44b2-b613-831f71a9b129" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.872654] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1028f99-d6d9-44b2-b613-831f71a9b129" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.872922] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1028f99-d6d9-44b2-b613-831f71a9b129" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.873017] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1028f99-d6d9-44b2-b613-831f71a9b129',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1430.933837] env[68328]: INFO networking_nsxv3.common.synchronization [None req-e903ce21-58f5-4af7-b084-f73540b945b0 tempest-AttachVolumeNegativeTest-1504481414 tempest-AttachVolumeNegativeTest-1504481414-project-member] Enqueued Resource ID: d1028f99-d6d9-44b2-b613-831f71a9b129 with Priority: HIGHEST for action security_group_rules [ 1430.934097] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1028f99-d6d9-44b2-b613-831f71a9b129 with Priority: HIGHEST for action security_group_rules [ 1430.934469] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1028f99-d6d9-44b2-b613-831f71a9b129 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.934469] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1028f99-d6d9-44b2-b613-831f71a9b129" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.397333] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.397521] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.397609] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.397835] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.397931] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.397991] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1028f99-d6d9-44b2-b613-831f71a9b129 already deleted. [ 1431.398089] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1028f99-d6d9-44b2-b613-831f71a9b129" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.398253] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1028f99-d6d9-44b2-b613-831f71a9b129" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.398429] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1028f99-d6d9-44b2-b613-831f71a9b129" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.398516] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1028f99-d6d9-44b2-b613-831f71a9b129',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1431.924917] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.925128] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.925128] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.925342] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.925429] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.925528] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1028f99-d6d9-44b2-b613-831f71a9b129 already deleted. [ 1431.925606] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1028f99-d6d9-44b2-b613-831f71a9b129" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.935027] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1435.935027] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1436.220123] env[68328]: INFO networking_nsxv3.common.synchronization [req-417c6f41-b361-438e-81ec-7474d86354c8 req-04aeddb3-86ec-4181-b247-fee4c0c70f0a tempest-AttachVolumeNegativeTest-1504481414 tempest-AttachVolumeNegativeTest-1504481414-project-member] Enqueued Resource ID: d1028f99-d6d9-44b2-b613-831f71a9b129 with Priority: HIGHEST for action security_group_members [ 1436.220123] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1028f99-d6d9-44b2-b613-831f71a9b129 with Priority: HIGHEST for action security_group_members [ 1436.220123] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1028f99-d6d9-44b2-b613-831f71a9b129 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.220676] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1028f99-d6d9-44b2-b613-831f71a9b129" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.220676] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1028f99-d6d9-44b2-b613-831f71a9b129" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.220676] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1028f99-d6d9-44b2-b613-831f71a9b129" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.220676] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.220883] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.220883] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.220955] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.221061] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.221133] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1028f99-d6d9-44b2-b613-831f71a9b129',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1436.470301] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-946 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.470498] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-946" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.470964] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-946" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.470964] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-946" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.471179] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.471341] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.471465] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.471681] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.471831] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.472184] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1436.472332] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1436.472453] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1436.472568] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1436.472685] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1436.472794] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1436.472930] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1436.492283] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1436.492444] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1436.492580] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1436.492744] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-946" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.493033] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-0a66308a-f3d2-4a83-8ee4-8e393f95d681 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.493201] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-0a66308a-f3d2-4a83-8ee4-8e393f95d681" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.493325] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-0a66308a-f3d2-4a83-8ee4-8e393f95d681" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.493636] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-0a66308a-f3d2-4a83-8ee4-8e393f95d681" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.493785] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a66308a-f3d2-4a83-8ee4-8e393f95d681',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1436.723278] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.723475] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.723475] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.723752] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.723859] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.724082] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.724201] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.724276] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.724410] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.724488] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.724770] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1028f99-d6d9-44b2-b613-831f71a9b129 already deleted. [ 1436.724770] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1028f99-d6d9-44b2-b613-831f71a9b129" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.996086] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.996086] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.996533] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.996533] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.996660] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.996801] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 0a66308a-f3d2-4a83-8ee4-8e393f95d681 not found, creating... [ 1436.997086] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.997272] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.997429] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.997672] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.997817] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.998137] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.998305] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.998427] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.998638] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.998777] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.998922] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 0a66308a-f3d2-4a83-8ee4-8e393f95d681 is going to be created. [ 1437.020233] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.020453] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.020498] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.020736] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.020961] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.021208] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-0a66308a-f3d2-4a83-8ee4-8e393f95d681" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.676185] env[68328]: INFO networking_nsxv3.common.synchronization [req-417c6f41-b361-438e-81ec-7474d86354c8 req-26d63e5d-5f77-4527-812b-e4965da44aff service nova] Enqueued Resource ID: d1028f99-d6d9-44b2-b613-831f71a9b129 with Priority: HIGHEST for action security_group_rules [ 1437.676417] env[68328]: INFO networking_nsxv3.common.synchronization [req-417c6f41-b361-438e-81ec-7474d86354c8 req-26d63e5d-5f77-4527-812b-e4965da44aff service nova] Enqueued Resource ID: d1028f99-d6d9-44b2-b613-831f71a9b129 with Priority: HIGHEST for action security_group_members [ 1437.676573] env[68328]: INFO networking_nsxv3.common.synchronization [req-417c6f41-b361-438e-81ec-7474d86354c8 req-26d63e5d-5f77-4527-812b-e4965da44aff service nova] Enqueued Resource ID: 0a66308a-f3d2-4a83-8ee4-8e393f95d681 with Priority: HIGHEST for action port [ 1437.676800] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1028f99-d6d9-44b2-b613-831f71a9b129 with Priority: HIGHEST for action security_group_rules [ 1437.676929] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1028f99-d6d9-44b2-b613-831f71a9b129 with Priority: HIGHEST for action security_group_members [ 1437.677035] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a66308a-f3d2-4a83-8ee4-8e393f95d681 with Priority: HIGHEST for action port [ 1437.677599] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1028f99-d6d9-44b2-b613-831f71a9b129 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.677733] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1028f99-d6d9-44b2-b613-831f71a9b129" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.677787] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1028f99-d6d9-44b2-b613-831f71a9b129" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.677984] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1028f99-d6d9-44b2-b613-831f71a9b129" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.678146] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1028f99-d6d9-44b2-b613-831f71a9b129',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1437.678928] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1028f99-d6d9-44b2-b613-831f71a9b129 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.679053] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1028f99-d6d9-44b2-b613-831f71a9b129" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.679122] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1028f99-d6d9-44b2-b613-831f71a9b129" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.679280] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1028f99-d6d9-44b2-b613-831f71a9b129" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.679420] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.679512] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.679623] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.679713] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.679797] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.679854] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1028f99-d6d9-44b2-b613-831f71a9b129',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1437.680988] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a66308a-f3d2-4a83-8ee4-8e393f95d681 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.680988] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a66308a-f3d2-4a83-8ee4-8e393f95d681" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.680988] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a66308a-f3d2-4a83-8ee4-8e393f95d681" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.681200] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a66308a-f3d2-4a83-8ee4-8e393f95d681" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.681200] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a66308a-f3d2-4a83-8ee4-8e393f95d681',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1438.183343] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d1028f99-d6d9-44b2-b613-831f71a9b129',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1438.184508] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1028f99-d6d9-44b2-b613-831f71a9b129 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.184626] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1028f99-d6d9-44b2-b613-831f71a9b129" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.184782] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0a66308a-f3d2-4a83-8ee4-8e393f95d681 with status ACTIVE [ 1438.184935] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.185062] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.185118] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1438.185307] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1438.185394] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1438.185563] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.185657] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.185715] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1438.185855] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1438.185929] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1438.186116] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.186204] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.186282] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1438.186435] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1438.186511] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1438.186594] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0a66308a-f3d2-4a83-8ee4-8e393f95d681 is going to be updated. [ 1438.208409] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.208568] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.208618] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1438.208749] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1438.208872] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1438.209030] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a66308a-f3d2-4a83-8ee4-8e393f95d681" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1438.689077] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d1028f99-d6d9-44b2-b613-831f71a9b129',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1439.191268] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.191580] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.191580] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.191711] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.191802] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.191901] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1028f99-d6d9-44b2-b613-831f71a9b129 is going to be created. [ 1439.218120] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.218311] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.218311] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.218650] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.218699] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.229679] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1028f99-d6d9-44b2-b613-831f71a9b129 in Status: UNINITIALIZED for 2s [ 1441.240046] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1028f99-d6d9-44b2-b613-831f71a9b129 in Status: SUCCESS [ 1441.240428] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1028f99-d6d9-44b2-b613-831f71a9b129" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1441.240428] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1028f99-d6d9-44b2-b613-831f71a9b129" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1441.240610] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1028f99-d6d9-44b2-b613-831f71a9b129" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1441.240796] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1441.240926] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1441.240992] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1441.241144] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1441.241227] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1441.241314] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1028f99-d6d9-44b2-b613-831f71a9b129" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1441.241404] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d1028f99-d6d9-44b2-b613-831f71a9b129',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1441.743216] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d1028f99-d6d9-44b2-b613-831f71a9b129',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1442.246310] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d1028f99-d6d9-44b2-b613-831f71a9b129: rpc.has_security_group_logging(os_id): False [ 1442.262856] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1442.262998] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1442.263094] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1442.263276] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1442.263364] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1442.263610] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1442.263703] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1442.263759] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1442.263912] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1442.263987] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1442.264083] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1028f99-d6d9-44b2-b613-831f71a9b129 is going to be created. [ 1442.318195] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1442.318356] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1442.318409] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1442.318575] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1442.318748] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1442.331770] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1028f99-d6d9-44b2-b613-831f71a9b129 in Status: IN_PROGRESS for 2s [ 1442.677907] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1442.677907] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1444.344072] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1028f99-d6d9-44b2-b613-831f71a9b129 in Status: SUCCESS [ 1444.344499] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1028f99-d6d9-44b2-b613-831f71a9b129" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1447.678732] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1447.679121] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1452.679683] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1452.680060] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1457.680936] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1457.681340] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1462.682329] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1462.682612] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1467.682947] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1467.683426] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1472.683953] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1472.684238] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1477.685293] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1477.685667] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1482.686069] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1482.686390] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1485.764673] env[68328]: INFO networking_nsxv3.common.synchronization [req-8fe61216-72ea-490c-996c-b5e19dd4ec4f req-bbbc7615-8ab6-45d7-a663-390a154c0850 tempest-AttachVolumeNegativeTest-1504481414 tempest-AttachVolumeNegativeTest-1504481414-project-member] Enqueued Resource ID: d1028f99-d6d9-44b2-b613-831f71a9b129 with Priority: HIGHEST for action security_group_members [ 1485.764673] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1028f99-d6d9-44b2-b613-831f71a9b129 with Priority: HIGHEST for action security_group_members [ 1485.765103] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1028f99-d6d9-44b2-b613-831f71a9b129 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.765103] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1028f99-d6d9-44b2-b613-831f71a9b129" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1485.765103] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1028f99-d6d9-44b2-b613-831f71a9b129" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1485.765305] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1028f99-d6d9-44b2-b613-831f71a9b129" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1485.765364] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.765457] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1485.765514] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1485.765649] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1485.766024] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1485.766024] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1028f99-d6d9-44b2-b613-831f71a9b129',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1486.268993] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1486.269305] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1486.269305] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1486.269458] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1486.269547] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1486.269743] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1486.269827] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1486.269912] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1486.270048] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1486.270124] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1486.270208] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1028f99-d6d9-44b2-b613-831f71a9b129 is going to be updated. [ 1486.297688] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1486.297879] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1486.297879] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1486.298046] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1486.298174] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1486.305916] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1028f99-d6d9-44b2-b613-831f71a9b129 in Status: IN_PROGRESS for 2s [ 1488.316982] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1028f99-d6d9-44b2-b613-831f71a9b129 in Status: SUCCESS [ 1488.317495] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1028f99-d6d9-44b2-b613-831f71a9b129 deletion is rescheduled due to dependency. [ 1488.317495] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1028f99-d6d9-44b2-b613-831f71a9b129" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.765490] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1490.765889] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1495.766180] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1495.766474] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1496.927512] env[68328]: INFO networking_nsxv3.common.synchronization [req-8a513acb-28ca-4758-a598-826b57deeacf req-aba4ccd4-c9c8-4225-920b-5a1e9b646266 tempest-AttachVolumeNegativeTest-1504481414 tempest-AttachVolumeNegativeTest-1504481414-project-member] Enqueued Resource ID: c2821544-c3c0-47e5-aba8-84dac3283194 with Priority: HIGHEST for action security_group_members [ 1496.928015] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2821544-c3c0-47e5-aba8-84dac3283194 with Priority: HIGHEST for action security_group_members [ 1496.928340] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-c2821544-c3c0-47e5-aba8-84dac3283194 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.928460] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c2821544-c3c0-47e5-aba8-84dac3283194" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.928530] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c2821544-c3c0-47e5-aba8-84dac3283194" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.928725] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c2821544-c3c0-47e5-aba8-84dac3283194" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.928906] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.929026] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.929122] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.929225] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.929320] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.929409] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c2821544-c3c0-47e5-aba8-84dac3283194',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1497.431378] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1497.431609] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1497.431609] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1497.431808] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1497.431896] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1497.432107] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1497.432219] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1497.432276] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1497.432411] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1497.432485] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1497.432569] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2821544-c3c0-47e5-aba8-84dac3283194 is going to be updated. [ 1497.458431] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1497.458595] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1497.458595] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1497.458746] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1497.458846] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1497.467908] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2821544-c3c0-47e5-aba8-84dac3283194 in Status: IN_PROGRESS for 2s [ 1499.478162] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c2821544-c3c0-47e5-aba8-84dac3283194 in Status: SUCCESS [ 1499.478623] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c2821544-c3c0-47e5-aba8-84dac3283194 deletion is rescheduled due to dependency. [ 1499.478623] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c2821544-c3c0-47e5-aba8-84dac3283194" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.510648] env[68328]: INFO networking_nsxv3.common.synchronization [None req-34a302a6-69fc-460f-9b3a-31e6e677c9b6 tempest-AttachVolumeNegativeTest-1504481414 tempest-AttachVolumeNegativeTest-1504481414-project-member] Enqueued Resource ID: c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839 with Priority: HIGHEST for action security_group_rules [ 1501.511166] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839 with Priority: HIGHEST for action security_group_rules [ 1501.511475] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.511594] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.511662] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.511921] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.512011] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1501.575661] env[68328]: INFO networking_nsxv3.common.synchronization [None req-411f2859-3591-4a1a-814b-e3b7f751f584 tempest-AttachVolumeNegativeTest-1504481414 tempest-AttachVolumeNegativeTest-1504481414-project-member] Enqueued Resource ID: c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839 with Priority: HIGHEST for action security_group_rules [ 1501.576176] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839 with Priority: HIGHEST for action security_group_rules [ 1501.576485] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.576587] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1502.032091] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.032235] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1502.032306] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1502.032514] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1502.032602] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1502.032695] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839 already deleted. [ 1502.032774] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1502.032912] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1502.033075] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1502.033157] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1502.552620] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.552959] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1502.552959] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1502.553077] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1502.553116] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1502.553209] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839 already deleted. [ 1502.553321] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.577272] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1506.577272] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1506.779687] env[68328]: INFO networking_nsxv3.common.synchronization [req-33b08127-cdd1-4b3e-adb9-fca02c74453e req-f8cdc3b0-5d43-42ea-953f-958f077d1185 tempest-AttachVolumeNegativeTest-1504481414 tempest-AttachVolumeNegativeTest-1504481414-project-member] Enqueued Resource ID: c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839 with Priority: HIGHEST for action security_group_members [ 1506.780276] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839 with Priority: HIGHEST for action security_group_members [ 1506.780583] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.780701] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.780771] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.781209] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.781383] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.781515] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.781583] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.781748] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.781830] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.781922] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1507.025458] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-946 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.025681] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-946" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.025814] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-946" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.026092] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-946" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.026359] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.026519] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.026640] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.026861] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.027054] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.027289] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1507.027411] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1507.027526] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1507.027642] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1507.027903] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1507.027903] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1507.028065] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1507.048746] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1507.048998] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1507.049096] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1507.049241] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-946" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.049570] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-a82ecceb-a734-4a6a-a831-2e1df578cf5e taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.049745] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-a82ecceb-a734-4a6a-a831-2e1df578cf5e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.049866] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-a82ecceb-a734-4a6a-a831-2e1df578cf5e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.050189] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-a82ecceb-a734-4a6a-a831-2e1df578cf5e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.050335] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a82ecceb-a734-4a6a-a831-2e1df578cf5e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1507.285605] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.285803] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.285848] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.286067] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.286150] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.286351] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.286451] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.286514] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.286671] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.286747] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.286831] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839 already deleted. [ 1507.286945] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.552909] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.553136] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.553229] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.553530] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.553654] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.553809] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port a82ecceb-a734-4a6a-a831-2e1df578cf5e not found, creating... [ 1507.554111] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.554312] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.554514] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.554761] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.554934] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.555260] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.555432] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.555555] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.555769] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.555911] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.556071] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: a82ecceb-a734-4a6a-a831-2e1df578cf5e is going to be created. [ 1507.576644] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.576847] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.577029] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.577274] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.577502] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.577723] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-a82ecceb-a734-4a6a-a831-2e1df578cf5e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.244522] env[68328]: INFO networking_nsxv3.common.synchronization [req-33b08127-cdd1-4b3e-adb9-fca02c74453e req-8f1d5f36-4713-421e-babe-e97feb95adea service nova] Enqueued Resource ID: c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839 with Priority: HIGHEST for action security_group_rules [ 1508.244715] env[68328]: INFO networking_nsxv3.common.synchronization [req-33b08127-cdd1-4b3e-adb9-fca02c74453e req-8f1d5f36-4713-421e-babe-e97feb95adea service nova] Enqueued Resource ID: c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839 with Priority: HIGHEST for action security_group_members [ 1508.244859] env[68328]: INFO networking_nsxv3.common.synchronization [req-33b08127-cdd1-4b3e-adb9-fca02c74453e req-8f1d5f36-4713-421e-babe-e97feb95adea service nova] Enqueued Resource ID: a82ecceb-a734-4a6a-a831-2e1df578cf5e with Priority: HIGHEST for action port [ 1508.245135] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839 with Priority: HIGHEST for action security_group_rules [ 1508.245277] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839 with Priority: HIGHEST for action security_group_members [ 1508.245395] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a82ecceb-a734-4a6a-a831-2e1df578cf5e with Priority: HIGHEST for action port [ 1508.245937] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.246091] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.246167] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.246327] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.246404] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.247236] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.247343] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.247406] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.247560] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.247699] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.247787] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.247843] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.247991] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.248110] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.248197] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.249239] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-a82ecceb-a734-4a6a-a831-2e1df578cf5e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.249345] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a82ecceb-a734-4a6a-a831-2e1df578cf5e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.249408] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a82ecceb-a734-4a6a-a831-2e1df578cf5e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.249560] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a82ecceb-a734-4a6a-a831-2e1df578cf5e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.249636] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a82ecceb-a734-4a6a-a831-2e1df578cf5e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.755271] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.755684] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.755684] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.756479] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a82ecceb-a734-4a6a-a831-2e1df578cf5e with status ACTIVE [ 1508.756663] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.756778] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.756838] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.757092] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.757206] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.757351] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.757448] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.757508] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.757664] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.757742] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.757940] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.758062] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.758122] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.758265] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.758339] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.758423] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a82ecceb-a734-4a6a-a831-2e1df578cf5e is going to be updated. [ 1508.780679] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.780871] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.780871] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.781055] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.781188] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.781362] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a82ecceb-a734-4a6a-a831-2e1df578cf5e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.260960] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1509.763504] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.763869] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.763869] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.763947] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.764030] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.764129] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839 is going to be created. [ 1509.788646] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.788779] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.788864] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.789043] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.789201] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.797574] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839 in Status: UNINITIALIZED for 2s [ 1511.807227] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839 in Status: SUCCESS [ 1511.807612] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.807612] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.807765] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.807956] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.808103] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.808165] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.808326] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.808403] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.808490] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.808577] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1512.311059] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1512.813223] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839: rpc.has_security_group_logging(os_id): False [ 1512.829529] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.829697] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.829744] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.829932] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.830030] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.830262] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.830358] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.830422] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.830566] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.830643] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.830725] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839 is going to be created. [ 1512.881999] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.882166] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.882226] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.882361] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.882526] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.892932] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839 in Status: IN_PROGRESS for 2s [ 1513.246405] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1513.246588] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1514.905666] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839 in Status: SUCCESS [ 1514.906072] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.247281] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1518.247692] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1523.248590] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1523.248944] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1528.249224] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1528.249668] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1533.249862] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1533.250249] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1538.251174] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1538.251543] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1543.252046] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1543.252442] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1548.254921] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1548.255344] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1553.256108] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1553.256484] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1555.311148] env[68328]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-038e1d26-3718-4954-be87-7b533345599d None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1555.311534] env[68328]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-038e1d26-3718-4954-be87-7b533345599d None None] NSXv3 Agent Agent loop - iteration:4 started [ 1558.257595] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1558.257853] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1561.273356] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1561.273787] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1561.273787] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1561.273787] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1561.273897] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1561.775990] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1562.278327] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1562.781147] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1562.781278] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1563.258556] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1563.258738] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1563.503706] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.504071] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.504071] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.504173] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.516782] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1563.517565] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.518250] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1563.553177] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.553338] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.553396] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.553542] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.566925] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.567605] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1563.567674] env[68328]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=68328) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1563.567765] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1563.598651] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.598812] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.598867] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.599037] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.599791] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.599930] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1563.677673] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.677842] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.677892] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.678070] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.678366] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.678628] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1563.753626] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.753794] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.753844] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.753992] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.754257] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.754487] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:30. [ 1563.754576] env[68328]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'6b8aa55c-e36f-4c45-be83-62ef79342d52', '8024e0cc-9eaa-4282-b00c-9e9b1de030e2', '54390b69-5280-4540-a63f-fa4daae4a11f', 'c2821544-c3c0-47e5-aba8-84dac3283194', '3826a056-9a94-48ea-97d8-49b840d3fb63', '10934b61-bf3e-4502-a16d-4256b90c2f37', 'b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724', '136bcfc4-bc92-46ea-9e01-01b9a11704ee', 'c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839', '70738fbe-b41d-467c-86c7-92a8c5a2a723', '078ed1cc-5f72-48f4-8e16-b1d53057c32e', '72ca69cd-fcd9-4815-b331-9858d9cfad42', '6e39d3b8-c430-4219-9295-992b699ce546', '35b651ef-47c8-4ff2-b472-9849f375b8c9', '7c35aa45-69e7-4952-b5d8-8a7d6b3460e1', '551b86cb-6c17-4238-9ac7-89fd77e1e91b', '8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b', 'd1028f99-d6d9-44b2-b613-831f71a9b129', 'b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38', '1b5440d1-45ae-41d0-a9b6-24cc237ec6a2', 'ce9938d1-497b-4835-b26f-069491d36e2e', '55dff300-131a-42f9-920d-f2b5a3b91449', 'fdf99f09-b7da-4a5c-af72-042c6f58dc8e', '4607d7c6-d635-4a5a-9767-6150fed7c420', 'b3fc1540-17fb-42c4-99d2-880ae35db079', 'b1c2fa85-ca03-4043-a12f-6ed71cf5c151', '7bef38e2-3a4a-4bc9-a5a1-19d1a6564a63', '4a187ea6-2982-413a-85b8-d76179583bdb', '3b0dcde5-1c71-45fa-b1b1-331b2ba39902', '57513254-a6e5-4b1e-87b8-b529d35f4b6b'} {{(pid=68328) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1563.754670] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1563.771286] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.771414] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.771414] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.771585] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.771668] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.771761] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1563.771832] env[68328]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=68328) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1563.771902] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1563.839890] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.840067] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.840067] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.840242] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.841294] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.841502] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1563.841581] env[68328]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=68328) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1563.841653] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1563.841721] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1563.841796] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/30 resources of Type:Security Group Rules [ 1563.841868] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6b8aa55c-e36f-4c45-be83-62ef79342d52 with Priority: HIGH for action security_group_rules [ 1563.841947] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 with Priority: HIGH for action security_group_rules [ 1563.842023] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 54390b69-5280-4540-a63f-fa4daae4a11f with Priority: HIGH for action security_group_rules [ 1563.842087] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c2821544-c3c0-47e5-aba8-84dac3283194 with Priority: HIGH for action security_group_rules [ 1563.842148] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3826a056-9a94-48ea-97d8-49b840d3fb63 with Priority: HIGH for action security_group_rules [ 1563.842210] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 10934b61-bf3e-4502-a16d-4256b90c2f37 with Priority: HIGH for action security_group_rules [ 1563.842271] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724 with Priority: HIGH for action security_group_rules [ 1563.842333] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 136bcfc4-bc92-46ea-9e01-01b9a11704ee with Priority: HIGH for action security_group_rules [ 1563.842393] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839 with Priority: HIGH for action security_group_rules [ 1563.842454] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 70738fbe-b41d-467c-86c7-92a8c5a2a723 with Priority: HIGH for action security_group_rules [ 1563.842515] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 078ed1cc-5f72-48f4-8e16-b1d53057c32e with Priority: HIGH for action security_group_rules [ 1563.842576] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 72ca69cd-fcd9-4815-b331-9858d9cfad42 with Priority: HIGH for action security_group_rules [ 1563.842637] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6e39d3b8-c430-4219-9295-992b699ce546 with Priority: HIGH for action security_group_rules [ 1563.842697] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 with Priority: HIGH for action security_group_rules [ 1563.842758] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 with Priority: HIGH for action security_group_rules [ 1563.842820] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 551b86cb-6c17-4238-9ac7-89fd77e1e91b with Priority: HIGH for action security_group_rules [ 1563.842880] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b with Priority: HIGH for action security_group_rules [ 1563.842942] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d1028f99-d6d9-44b2-b613-831f71a9b129 with Priority: HIGH for action security_group_rules [ 1563.843012] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38 with Priority: HIGH for action security_group_rules [ 1563.843078] env[68328]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1b5440d1-45ae-41d0-a9b6-24cc237ec6a2 with Priority: HIGH for action security_group_rules [ 1563.843167] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.260580] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1568.260580] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1568.260580] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b8aa55c-e36f-4c45-be83-62ef79342d52 with Priority: HIGH for action security_group_rules [ 1568.260580] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54390b69-5280-4540-a63f-fa4daae4a11f with Priority: HIGH for action security_group_rules [ 1568.260580] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724 with Priority: HIGH for action security_group_rules [ 1568.260580] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 with Priority: HIGH for action security_group_rules [ 1568.260580] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b5440d1-45ae-41d0-a9b6-24cc237ec6a2 with Priority: HIGH for action security_group_rules [ 1568.261212] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38 with Priority: HIGH for action security_group_rules [ 1568.261212] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1028f99-d6d9-44b2-b613-831f71a9b129 with Priority: HIGH for action security_group_rules [ 1568.261212] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b with Priority: HIGH for action security_group_rules [ 1568.261212] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 with Priority: HIGH for action security_group_rules [ 1568.261212] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 551b86cb-6c17-4238-9ac7-89fd77e1e91b with Priority: HIGH for action security_group_rules [ 1568.261212] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e39d3b8-c430-4219-9295-992b699ce546 with Priority: HIGH for action security_group_rules [ 1568.261212] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72ca69cd-fcd9-4815-b331-9858d9cfad42 with Priority: HIGH for action security_group_rules [ 1568.261212] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 078ed1cc-5f72-48f4-8e16-b1d53057c32e with Priority: HIGH for action security_group_rules [ 1568.261590] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70738fbe-b41d-467c-86c7-92a8c5a2a723 with Priority: HIGH for action security_group_rules [ 1568.261590] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839 with Priority: HIGH for action security_group_rules [ 1568.261590] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10934b61-bf3e-4502-a16d-4256b90c2f37 with Priority: HIGH for action security_group_rules [ 1568.261590] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 136bcfc4-bc92-46ea-9e01-01b9a11704ee with Priority: HIGH for action security_group_rules [ 1568.261717] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3826a056-9a94-48ea-97d8-49b840d3fb63 with Priority: HIGH for action security_group_rules [ 1568.261756] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 with Priority: HIGH for action security_group_rules [ 1568.261890] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2821544-c3c0-47e5-aba8-84dac3283194 with Priority: HIGH for action security_group_rules [ 1568.262193] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b8aa55c-e36f-4c45-be83-62ef79342d52 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.262324] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b8aa55c-e36f-4c45-be83-62ef79342d52" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.262388] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b8aa55c-e36f-4c45-be83-62ef79342d52" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.262585] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b8aa55c-e36f-4c45-be83-62ef79342d52" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.262689] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b8aa55c-e36f-4c45-be83-62ef79342d52',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1568.263650] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54390b69-5280-4540-a63f-fa4daae4a11f taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.263769] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.263831] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.264029] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.264103] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54390b69-5280-4540-a63f-fa4daae4a11f',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1568.265114] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.265283] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.265283] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.265455] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.265523] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1568.266269] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.266269] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.266407] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.266462] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.266521] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c35aa45-69e7-4952-b5d8-8a7d6b3460e1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1568.267236] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b5440d1-45ae-41d0-a9b6-24cc237ec6a2 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.267366] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b5440d1-45ae-41d0-a9b6-24cc237ec6a2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.268111] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b5440d1-45ae-41d0-a9b6-24cc237ec6a2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.268111] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b5440d1-45ae-41d0-a9b6-24cc237ec6a2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.268111] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b5440d1-45ae-41d0-a9b6-24cc237ec6a2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1568.268374] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.268485] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.268557] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.268714] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.268788] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1568.271080] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1028f99-d6d9-44b2-b613-831f71a9b129 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.271188] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1028f99-d6d9-44b2-b613-831f71a9b129" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.271254] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1028f99-d6d9-44b2-b613-831f71a9b129" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.271396] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1028f99-d6d9-44b2-b613-831f71a9b129" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.271497] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1028f99-d6d9-44b2-b613-831f71a9b129',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1568.272115] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.272218] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.272328] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.272472] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.272511] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1568.273144] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-35b651ef-47c8-4ff2-b472-9849f375b8c9 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.273245] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.273308] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.273459] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.273531] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('35b651ef-47c8-4ff2-b472-9849f375b8c9',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1568.274184] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-551b86cb-6c17-4238-9ac7-89fd77e1e91b taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.274291] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-551b86cb-6c17-4238-9ac7-89fd77e1e91b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.274353] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-551b86cb-6c17-4238-9ac7-89fd77e1e91b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.274499] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-551b86cb-6c17-4238-9ac7-89fd77e1e91b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.274572] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('551b86cb-6c17-4238-9ac7-89fd77e1e91b',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1568.405664] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e39d3b8-c430-4219-9295-992b699ce546 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.405842] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e39d3b8-c430-4219-9295-992b699ce546" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.405910] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e39d3b8-c430-4219-9295-992b699ce546" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.406107] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e39d3b8-c430-4219-9295-992b699ce546" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.406186] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e39d3b8-c430-4219-9295-992b699ce546',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1568.406981] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72ca69cd-fcd9-4815-b331-9858d9cfad42 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.407109] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72ca69cd-fcd9-4815-b331-9858d9cfad42" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.407170] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72ca69cd-fcd9-4815-b331-9858d9cfad42" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.407330] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72ca69cd-fcd9-4815-b331-9858d9cfad42" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.407480] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72ca69cd-fcd9-4815-b331-9858d9cfad42',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1568.408077] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-078ed1cc-5f72-48f4-8e16-b1d53057c32e taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.408255] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-078ed1cc-5f72-48f4-8e16-b1d53057c32e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.408329] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-078ed1cc-5f72-48f4-8e16-b1d53057c32e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.408490] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-078ed1cc-5f72-48f4-8e16-b1d53057c32e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.408574] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('078ed1cc-5f72-48f4-8e16-b1d53057c32e',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1568.409538] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70738fbe-b41d-467c-86c7-92a8c5a2a723 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.409651] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70738fbe-b41d-467c-86c7-92a8c5a2a723" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.409715] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70738fbe-b41d-467c-86c7-92a8c5a2a723" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.409898] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70738fbe-b41d-467c-86c7-92a8c5a2a723" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.409997] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70738fbe-b41d-467c-86c7-92a8c5a2a723',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1568.410662] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.410770] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.410832] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.410981] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.411064] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1568.411702] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-10934b61-bf3e-4502-a16d-4256b90c2f37 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.411809] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-10934b61-bf3e-4502-a16d-4256b90c2f37" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.411869] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-10934b61-bf3e-4502-a16d-4256b90c2f37" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.412030] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-10934b61-bf3e-4502-a16d-4256b90c2f37" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.412102] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('10934b61-bf3e-4502-a16d-4256b90c2f37',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1568.412807] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-136bcfc4-bc92-46ea-9e01-01b9a11704ee taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.412912] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-136bcfc4-bc92-46ea-9e01-01b9a11704ee" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.412971] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-136bcfc4-bc92-46ea-9e01-01b9a11704ee" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.413133] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-136bcfc4-bc92-46ea-9e01-01b9a11704ee" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.413194] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('136bcfc4-bc92-46ea-9e01-01b9a11704ee',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1568.413832] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3826a056-9a94-48ea-97d8-49b840d3fb63 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.413938] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3826a056-9a94-48ea-97d8-49b840d3fb63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.413996] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3826a056-9a94-48ea-97d8-49b840d3fb63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.414157] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3826a056-9a94-48ea-97d8-49b840d3fb63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.414230] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3826a056-9a94-48ea-97d8-49b840d3fb63',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1568.414871] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8024e0cc-9eaa-4282-b00c-9e9b1de030e2 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.414979] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.415057] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.415203] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.415274] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8024e0cc-9eaa-4282-b00c-9e9b1de030e2',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1568.415907] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c2821544-c3c0-47e5-aba8-84dac3283194 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.416107] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c2821544-c3c0-47e5-aba8-84dac3283194" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.416180] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c2821544-c3c0-47e5-aba8-84dac3283194" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.416327] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c2821544-c3c0-47e5-aba8-84dac3283194" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.416397] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c2821544-c3c0-47e5-aba8-84dac3283194',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1568.457564] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.457773] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.457773] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.457895] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.459704] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.459826] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.460475] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.460571] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.461193] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.461285] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.461944] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.462050] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.463044] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.463148] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.463876] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.463976] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.479437] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.479546] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1028f99-d6d9-44b2-b613-831f71a9b129 is going to be deleted. [ 1568.480267] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.480453] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.498152] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.498274] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38 is going to be deleted. [ 1568.499546] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.499546] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.513852] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.513985] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c2821544-c3c0-47e5-aba8-84dac3283194 is going to be deleted. [ 1568.514698] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.514874] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.533759] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.533863] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54390b69-5280-4540-a63f-fa4daae4a11f is going to be deleted. [ 1568.534617] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.534785] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.542511] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.542653] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.548806] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.548924] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.554203] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.554304] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b is going to be deleted. [ 1568.554973] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.555157] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.588869] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.589046] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72ca69cd-fcd9-4815-b331-9858d9cfad42 is going to be deleted. [ 1568.589733] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.589953] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.591231] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.591329] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.633593] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.633767] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.643343] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.643442] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 35b651ef-47c8-4ff2-b472-9849f375b8c9 is going to be deleted. [ 1568.644149] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.644328] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.644415] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.644531] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1028f99-d6d9-44b2-b613-831f71a9b129" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.644679] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.644826] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.644900] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.645011] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b666abeb-4c0b-4b5a-98b0-4b2b55c1eb38" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.645417] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.645606] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.645694] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.645831] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c2821544-c3c0-47e5-aba8-84dac3283194" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.645961] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.646119] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.646195] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.646300] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54390b69-5280-4540-a63f-fa4daae4a11f" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.694991] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.695173] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.695216] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.695395] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.695484] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.695630] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c7a7cf5-5115-4a3d-aaa3-5b2c51f5f85b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.699299] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.699432] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.699772] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.699772] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.699772] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.699934] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72ca69cd-fcd9-4815-b331-9858d9cfad42" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.778853] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.779038] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.779095] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.779275] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.779362] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.779480] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-35b651ef-47c8-4ff2-b472-9849f375b8c9" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.925755] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.925971] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.925971] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.926163] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.926304] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.926401] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.926518] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.926601] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.926684] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.926766] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.926850] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1568.971520] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.971755] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.971755] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.972346] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.973511] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.973648] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.974314] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.974407] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.975134] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.975224] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.976413] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.976561] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.977148] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.977292] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.977864] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.977954] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.978626] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.978727] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.979349] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.979441] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.980095] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.980185] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.980861] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.980948] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.981561] env[68328]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1568.981921] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.982034] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.990642] env[68328]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1568.991035] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.991146] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e39d3b8-c430-4219-9295-992b699ce546 is going to be deleted. [ 1568.991939] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.992131] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.008197] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.008276] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3826a056-9a94-48ea-97d8-49b840d3fb63 is going to be deleted. [ 1569.009141] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.009311] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.023478] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.023582] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 136bcfc4-bc92-46ea-9e01-01b9a11704ee is going to be deleted. [ 1569.024251] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.024422] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.050178] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.050285] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c35aa45-69e7-4952-b5d8-8a7d6b3460e1 is going to be deleted. [ 1569.050941] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.051140] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.052370] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.052473] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.062552] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.062650] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.071528] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.071625] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 078ed1cc-5f72-48f4-8e16-b1d53057c32e is going to be deleted. [ 1569.072301] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.072466] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.082761] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.082894] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.087213] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.087330] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70738fbe-b41d-467c-86c7-92a8c5a2a723 is going to be deleted. [ 1569.088023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.088193] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.119453] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.119565] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 10934b61-bf3e-4502-a16d-4256b90c2f37 is going to be deleted. [ 1569.120248] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.120417] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.136507] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.136622] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.143323] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.143424] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b5440d1-45ae-41d0-a9b6-24cc237ec6a2 is going to be deleted. [ 1569.144132] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.144303] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.194364] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.194557] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.199422] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.199526] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 551b86cb-6c17-4238-9ac7-89fd77e1e91b is going to be deleted. [ 1569.200303] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.200497] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.216013] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.216131] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.233219] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.233377] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.236946] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.237064] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b8aa55c-e36f-4c45-be83-62ef79342d52 is going to be deleted. [ 1569.237817] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.238023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.269162] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.269448] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.281658] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.281823] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8024e0cc-9eaa-4282-b00c-9e9b1de030e2 is going to be deleted. [ 1569.282750] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.282888] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.303655] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.303857] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.338775] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.338943] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724 is going to be deleted. [ 1569.339795] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.340015] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.340112] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.340236] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e39d3b8-c430-4219-9295-992b699ce546" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.340391] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.340577] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.340673] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.340788] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3826a056-9a94-48ea-97d8-49b840d3fb63" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.341293] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.341457] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.341540] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.341655] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-136bcfc4-bc92-46ea-9e01-01b9a11704ee" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.341806] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.341958] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.342051] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.342168] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c35aa45-69e7-4952-b5d8-8a7d6b3460e1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.342295] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.342437] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.342510] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.342611] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70738fbe-b41d-467c-86c7-92a8c5a2a723" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.342737] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.342874] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.342946] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.343088] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-078ed1cc-5f72-48f4-8e16-b1d53057c32e" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.343216] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.343355] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.343421] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.343516] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-10934b61-bf3e-4502-a16d-4256b90c2f37" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.343636] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.343773] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.343843] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.343952] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b5440d1-45ae-41d0-a9b6-24cc237ec6a2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.344090] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.344231] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.344300] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.344401] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-551b86cb-6c17-4238-9ac7-89fd77e1e91b" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.388453] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.388672] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.388672] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.388860] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.388948] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.389078] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b8aa55c-e36f-4c45-be83-62ef79342d52" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.431637] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1569.451338] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.451631] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.451631] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.451775] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.451866] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.451982] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8024e0cc-9eaa-4282-b00c-9e9b1de030e2" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.503335] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.503494] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.503556] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.503752] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.503842] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.503957] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b0f6cb2a-6580-4f1b-8e8d-96c8a96e7724" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.934275] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839: rpc.has_security_group_logging(os_id): False [ 1569.951193] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.951369] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.951415] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.951582] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.970152] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.970413] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.970520] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.970577] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.970748] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.970830] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.970919] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839 is going to be updated. [ 1570.028796] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1570.028978] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1570.028978] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1570.029198] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1570.029337] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1570.042227] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839 in Status: IN_PROGRESS for 2s [ 1570.671014] env[68328]: INFO networking_nsxv3.common.synchronization [req-5c5cafc3-8e14-47de-8adb-6db126d44a46 req-f78b9eeb-cf84-4a13-a82a-dcbf3deeec7d tempest-AttachVolumeNegativeTest-1504481414 tempest-AttachVolumeNegativeTest-1504481414-project-member] Enqueued Resource ID: c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839 with Priority: HIGHEST for action security_group_members [ 1570.671014] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839 with Priority: HIGHEST for action security_group_members [ 1570.671014] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1570.671014] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1570.671014] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1570.671014] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1570.671014] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1570.671014] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1570.671014] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1570.671014] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1570.671014] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1570.672119] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1571.174052] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1571.174220] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1571.174289] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1571.174510] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1571.174603] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.174802] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1571.174897] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1571.174959] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1571.175131] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1571.175218] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.175295] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839 is going to be updated. [ 1571.203998] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1571.204138] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1571.204181] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1571.204342] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1571.204464] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.212086] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839 in Status: IN_PROGRESS for 2s [ 1572.057976] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839 in Status: SUCCESS [ 1572.058283] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.221570] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839 in Status: SUCCESS [ 1573.221902] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839 deletion is rescheduled due to dependency. [ 1573.221902] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7f1cc49-08cb-4cf8-9b88-3fc5e35f2839" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1575.273723] env[68328]: INFO networking_nsxv3.common.synchronization [None req-0370170b-1b2a-4f47-98bf-fdd2195439c9 tempest-AttachVolumeNegativeTest-1504481414 tempest-AttachVolumeNegativeTest-1504481414-project-member] Enqueued Resource ID: 5e575b06-7158-4a6a-b17a-901a52c20fd1 with Priority: HIGHEST for action security_group_rules [ 1575.274265] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e575b06-7158-4a6a-b17a-901a52c20fd1 with Priority: HIGHEST for action security_group_rules [ 1575.274572] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e575b06-7158-4a6a-b17a-901a52c20fd1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1575.274693] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e575b06-7158-4a6a-b17a-901a52c20fd1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1575.274759] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e575b06-7158-4a6a-b17a-901a52c20fd1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1575.275014] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e575b06-7158-4a6a-b17a-901a52c20fd1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1575.275104] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e575b06-7158-4a6a-b17a-901a52c20fd1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1575.337373] env[68328]: INFO networking_nsxv3.common.synchronization [None req-2a65d7a0-5ca7-43dd-995e-a7b7c36162de tempest-AttachVolumeNegativeTest-1504481414 tempest-AttachVolumeNegativeTest-1504481414-project-member] Enqueued Resource ID: 5e575b06-7158-4a6a-b17a-901a52c20fd1 with Priority: HIGHEST for action security_group_rules [ 1575.337859] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e575b06-7158-4a6a-b17a-901a52c20fd1 with Priority: HIGHEST for action security_group_rules [ 1575.338165] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e575b06-7158-4a6a-b17a-901a52c20fd1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1575.338269] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e575b06-7158-4a6a-b17a-901a52c20fd1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1575.796757] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1575.796925] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1575.796957] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1575.797358] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1575.797358] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1575.797474] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e575b06-7158-4a6a-b17a-901a52c20fd1 already deleted. [ 1575.797474] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e575b06-7158-4a6a-b17a-901a52c20fd1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1575.797622] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e575b06-7158-4a6a-b17a-901a52c20fd1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1575.797803] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e575b06-7158-4a6a-b17a-901a52c20fd1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1575.797887] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e575b06-7158-4a6a-b17a-901a52c20fd1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1576.317496] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1576.317877] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1576.317877] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1576.317932] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1576.318038] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1576.318136] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e575b06-7158-4a6a-b17a-901a52c20fd1 already deleted. [ 1576.318238] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e575b06-7158-4a6a-b17a-901a52c20fd1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1580.338623] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1580.339138] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1580.506142] env[68328]: INFO networking_nsxv3.common.synchronization [req-c2ac8c53-467d-4503-ac0e-dd2f8240a6b1 req-8ce88deb-dcdd-4ca2-af71-8390cf7f620b tempest-AttachVolumeNegativeTest-1504481414 tempest-AttachVolumeNegativeTest-1504481414-project-member] Enqueued Resource ID: 5e575b06-7158-4a6a-b17a-901a52c20fd1 with Priority: HIGHEST for action security_group_members [ 1580.506683] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e575b06-7158-4a6a-b17a-901a52c20fd1 with Priority: HIGHEST for action security_group_members [ 1580.506996] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e575b06-7158-4a6a-b17a-901a52c20fd1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1580.507131] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e575b06-7158-4a6a-b17a-901a52c20fd1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1580.507198] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e575b06-7158-4a6a-b17a-901a52c20fd1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1580.507444] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e575b06-7158-4a6a-b17a-901a52c20fd1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1580.507613] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1580.507721] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1580.507772] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1580.507923] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1580.508014] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1580.508560] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e575b06-7158-4a6a-b17a-901a52c20fd1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1580.788369] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock network-946 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1580.788586] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "network-946" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1580.788744] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "network-946" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1580.789021] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "network-946" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1580.789289] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1580.789448] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1580.789569] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1580.789789] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1580.789960] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1580.790216] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1580.790333] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] NeedRegenerationException {{(pid=68328) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1580.790450] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] no value, waiting for create lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1580.790550] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] value creation lock acquired {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1580.790666] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] No value present for key: 'zone-id' {{(pid=68328) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1580.790778] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Calling creation function for not-yet-present value {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1580.790913] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1580.811987] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1580.812162] env[68328]: DEBUG dogpile.cache.region [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=68328) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1580.812302] env[68328]: DEBUG dogpile.lock [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Released creation lock {{(pid=68328) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1580.812465] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "network-946" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1580.812755] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock port-2a221052-2fcb-4dad-8d1a-cf25e92d13f5 taken with stack trace [, , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1580.812895] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "port-2a221052-2fcb-4dad-8d1a-cf25e92d13f5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1580.813030] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "port-2a221052-2fcb-4dad-8d1a-cf25e92d13f5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1580.813313] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "port-2a221052-2fcb-4dad-8d1a-cf25e92d13f5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1580.813452] env[68328]: DEBUG networking_nsxv3.api.rpc [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a221052-2fcb-4dad-8d1a-cf25e92d13f5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1581.010485] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1581.010644] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1581.010742] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1581.010966] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1581.011083] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1581.011282] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1581.011381] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1581.011445] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1581.011597] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1581.011712] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1581.011773] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e575b06-7158-4a6a-b17a-901a52c20fd1 already deleted. [ 1581.011879] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e575b06-7158-4a6a-b17a-901a52c20fd1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1581.315777] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1581.316030] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1581.316224] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1581.316546] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1581.316753] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1581.316961] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Segment Port 2a221052-2fcb-4dad-8d1a-cf25e92d13f5 not found, creating... [ 1581.317294] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1581.317500] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1581.317692] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1581.317969] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1581.318176] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1581.318506] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1581.318721] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1581.318880] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1581.319149] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1581.319342] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1581.319527] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Resource: SegmentPort with ID: 2a221052-2fcb-4dad-8d1a-cf25e92d13f5 is going to be created. [ 1581.339059] env[68328]: DEBUG networking_nsxv3.common.locking [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1581.339388] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1581.339388] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1581.339610] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1581.339836] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1581.340093] env[68328]: DEBUG oslo_concurrency.lockutils [None req-7ed83870-8178-4c2c-846f-11e0a4f0f6b7 None None] Releasing lock "port-2a221052-2fcb-4dad-8d1a-cf25e92d13f5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1581.992928] env[68328]: INFO networking_nsxv3.common.synchronization [req-c2ac8c53-467d-4503-ac0e-dd2f8240a6b1 req-2cf08a74-eab8-47e2-9f69-c8f13adaa6cf service nova] Enqueued Resource ID: 5e575b06-7158-4a6a-b17a-901a52c20fd1 with Priority: HIGHEST for action security_group_rules [ 1581.993128] env[68328]: INFO networking_nsxv3.common.synchronization [req-c2ac8c53-467d-4503-ac0e-dd2f8240a6b1 req-2cf08a74-eab8-47e2-9f69-c8f13adaa6cf service nova] Enqueued Resource ID: 5e575b06-7158-4a6a-b17a-901a52c20fd1 with Priority: HIGHEST for action security_group_members [ 1581.993273] env[68328]: INFO networking_nsxv3.common.synchronization [req-c2ac8c53-467d-4503-ac0e-dd2f8240a6b1 req-2cf08a74-eab8-47e2-9f69-c8f13adaa6cf service nova] Enqueued Resource ID: 2a221052-2fcb-4dad-8d1a-cf25e92d13f5 with Priority: HIGHEST for action port [ 1581.993495] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e575b06-7158-4a6a-b17a-901a52c20fd1 with Priority: HIGHEST for action security_group_rules [ 1581.993623] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e575b06-7158-4a6a-b17a-901a52c20fd1 with Priority: HIGHEST for action security_group_members [ 1581.993721] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a221052-2fcb-4dad-8d1a-cf25e92d13f5 with Priority: HIGHEST for action port [ 1581.994288] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e575b06-7158-4a6a-b17a-901a52c20fd1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1581.994416] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e575b06-7158-4a6a-b17a-901a52c20fd1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1581.994475] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e575b06-7158-4a6a-b17a-901a52c20fd1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1581.994670] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e575b06-7158-4a6a-b17a-901a52c20fd1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1581.994750] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e575b06-7158-4a6a-b17a-901a52c20fd1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1581.997034] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e575b06-7158-4a6a-b17a-901a52c20fd1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1581.997158] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e575b06-7158-4a6a-b17a-901a52c20fd1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1581.997275] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e575b06-7158-4a6a-b17a-901a52c20fd1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1581.997479] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e575b06-7158-4a6a-b17a-901a52c20fd1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1581.997666] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1581.997770] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1581.997876] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1581.997992] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1581.998081] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1581.998171] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e575b06-7158-4a6a-b17a-901a52c20fd1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1581.999369] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a221052-2fcb-4dad-8d1a-cf25e92d13f5 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1581.999369] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a221052-2fcb-4dad-8d1a-cf25e92d13f5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1581.999369] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a221052-2fcb-4dad-8d1a-cf25e92d13f5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1581.999513] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a221052-2fcb-4dad-8d1a-cf25e92d13f5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1581.999587] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a221052-2fcb-4dad-8d1a-cf25e92d13f5',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1582.502701] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e575b06-7158-4a6a-b17a-901a52c20fd1 taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1582.502701] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e575b06-7158-4a6a-b17a-901a52c20fd1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1582.502701] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e575b06-7158-4a6a-b17a-901a52c20fd1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1582.503077] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2a221052-2fcb-4dad-8d1a-cf25e92d13f5 with status ACTIVE [ 1582.503109] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1582.503215] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1582.503280] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1582.503471] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1582.503557] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1582.503730] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1582.503840] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1582.503902] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1582.504064] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1582.504141] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1582.504320] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1582.504410] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1582.504467] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1582.504597] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1582.504682] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1582.504763] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2a221052-2fcb-4dad-8d1a-cf25e92d13f5 is going to be updated. [ 1582.528605] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1582.528737] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1582.528814] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1582.528973] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1582.529111] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1582.529252] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a221052-2fcb-4dad-8d1a-cf25e92d13f5" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1583.006959] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e575b06-7158-4a6a-b17a-901a52c20fd1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1583.509134] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.509441] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.509441] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.509581] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.509632] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1583.509725] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e575b06-7158-4a6a-b17a-901a52c20fd1 is going to be created. [ 1583.536286] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.536497] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.536497] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.536670] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.536819] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1583.547619] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e575b06-7158-4a6a-b17a-901a52c20fd1 in Status: UNINITIALIZED for 2s [ 1585.562910] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e575b06-7158-4a6a-b17a-901a52c20fd1 in Status: SUCCESS [ 1585.563233] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e575b06-7158-4a6a-b17a-901a52c20fd1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1585.563350] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e575b06-7158-4a6a-b17a-901a52c20fd1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1585.563505] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e575b06-7158-4a6a-b17a-901a52c20fd1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1585.563697] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1585.563815] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1585.563879] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1585.564041] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1585.564123] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1585.564209] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e575b06-7158-4a6a-b17a-901a52c20fd1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1585.564297] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5e575b06-7158-4a6a-b17a-901a52c20fd1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1586.066027] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5e575b06-7158-4a6a-b17a-901a52c20fd1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1586.568623] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5e575b06-7158-4a6a-b17a-901a52c20fd1: rpc.has_security_group_logging(os_id): False [ 1586.587014] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1586.587159] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1586.587233] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1586.587432] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1586.587520] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1586.587802] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1586.587894] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1586.587955] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1586.588120] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1586.588196] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1586.588282] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e575b06-7158-4a6a-b17a-901a52c20fd1 is going to be created. [ 1586.643323] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1586.643454] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1586.643540] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1586.643666] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1586.643833] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1586.652687] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e575b06-7158-4a6a-b17a-901a52c20fd1 in Status: IN_PROGRESS for 2s [ 1586.994708] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1586.994928] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1588.665891] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e575b06-7158-4a6a-b17a-901a52c20fd1 in Status: SUCCESS [ 1588.666144] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e575b06-7158-4a6a-b17a-901a52c20fd1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1591.995639] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1591.995982] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1596.997136] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1596.997472] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1601.998420] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1601.998757] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1606.999847] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1607.000268] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1612.001739] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1612.002128] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1617.003690] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1617.004056] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1622.004660] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1622.005050] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1627.006375] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1627.006624] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1632.007643] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1632.008124] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1637.009399] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1637.009642] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1642.010113] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1642.010507] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1643.671492] env[68328]: INFO networking_nsxv3.common.synchronization [req-0f6c583f-f434-47a8-9117-2aa444099de7 req-630a150c-8e41-4cf2-8847-4f738ef5d5e3 tempest-AttachVolumeNegativeTest-1504481414 tempest-AttachVolumeNegativeTest-1504481414-project-member] Enqueued Resource ID: 5e575b06-7158-4a6a-b17a-901a52c20fd1 with Priority: HIGHEST for action security_group_members [ 1643.671747] env[68328]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e575b06-7158-4a6a-b17a-901a52c20fd1 with Priority: HIGHEST for action security_group_members [ 1643.671879] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e575b06-7158-4a6a-b17a-901a52c20fd1 taken with stack trace [, , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1643.672023] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e575b06-7158-4a6a-b17a-901a52c20fd1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1643.672093] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e575b06-7158-4a6a-b17a-901a52c20fd1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1643.672302] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e575b06-7158-4a6a-b17a-901a52c20fd1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1643.672455] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1643.672550] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1643.672613] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1643.672759] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1643.672847] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1643.672935] env[68328]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e575b06-7158-4a6a-b17a-901a52c20fd1',) {} {{(pid=68328) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1644.175169] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1644.175331] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1644.175370] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1644.175555] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1644.175645] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1644.175837] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1644.175930] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1644.175993] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1644.176158] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1644.176236] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1644.176322] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e575b06-7158-4a6a-b17a-901a52c20fd1 is going to be updated. [ 1644.209759] env[68328]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68328) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1644.209918] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1644.209955] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1644.210126] env[68328]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1644.210260] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1644.217843] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e575b06-7158-4a6a-b17a-901a52c20fd1 in Status: IN_PROGRESS for 2s [ 1646.228612] env[68328]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e575b06-7158-4a6a-b17a-901a52c20fd1 in Status: SUCCESS [ 1646.228978] env[68328]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e575b06-7158-4a6a-b17a-901a52c20fd1 deletion is rescheduled due to dependency. [ 1646.228978] env[68328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e575b06-7158-4a6a-b17a-901a52c20fd1" {{(pid=68328) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1648.672541] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1648.672541] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1653.673340] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1653.673671] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1658.674848] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1658.675267] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1663.676274] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1663.676637] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1668.677267] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1668.677623] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1673.678823] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1673.678823] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1678.679507] env[68328]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1678.679507] env[68328]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0